Preliminary WMT24 Ranking of General MT Systems and LLMs
This is an incremental report offering temporary rankings for participants in a specific machine translation task, with no broader impact claimed.
The paper presents preliminary automatic metric rankings for general machine translation systems and large language models in the WMT24 competition, providing participants with early results for their system submission write-ups.
This is the preliminary ranking of WMT24 General MT systems based on automatic metrics. The official ranking will be a human evaluation, which is superior to the automatic ranking and supersedes it. The purpose of this report is not to interpret any findings but only provide preliminary results to the participants of the General MT task that may be useful during the writing of the system submission.