The Automated Verification of Textual Claims (AVeriTeC) Shared Task
This addresses the problem of automating fact-checking for researchers and practitioners, but it is incremental as it builds on existing shared task frameworks.
The AVeriTeC shared task tackled automated verification of real-world claims by requiring participants to retrieve evidence and predict veracity, with the winning team achieving an AVeriTeC score of 63%.
The Automated Verification of Textual Claims (AVeriTeC) shared task asks participants to retrieve evidence and predict veracity for real-world claims checked by fact-checkers. Evidence can be found either via a search engine, or via a knowledge store provided by the organisers. Submissions are evaluated using AVeriTeC score, which considers a claim to be accurately verified if and only if both the verdict is correct and retrieved evidence is considered to meet a certain quality threshold. The shared task received 21 submissions, 18 of which surpassed our baseline. The winning team was TUDA_MAI with an AVeriTeC score of 63%. In this paper we describe the shared task, present the full results, and highlight key takeaways from the shared task.