CLAIMar 19, 2025

The CLEF-2025 CheckThat! Lab: Subjectivity, Fact-Checking, Claim Normalization, and Retrieval

arXiv:2503.14828v133 citationsh-index: 47ECIR
Originality Synthesis-oriented
AI Analysis

This work addresses the problem of combating disinformation for researchers and practitioners, but it is incremental as it builds on previous editions of the lab.

The CLEF-2025 CheckThat! Lab tackles online disinformation by organizing tasks for subjectivity identification, claim normalization, fact-checking numerical claims, and scientific web discourse processing, focusing on classification and retrieval challenges in multilingual settings.

The CheckThat! lab aims to advance the development of innovative technologies designed to identify and counteract online disinformation and manipulation efforts across various languages and platforms. The first five editions focused on key tasks in the information verification pipeline, including check-worthiness, evidence retrieval and pairing, and verification. Since the 2023 edition, the lab has expanded its scope to address auxiliary tasks that support research and decision-making in verification. In the 2025 edition, the lab revisits core verification tasks while also considering auxiliary challenges. Task 1 focuses on the identification of subjectivity (a follow-up from CheckThat! 2024), Task 2 addresses claim normalization, Task 3 targets fact-checking numerical claims, and Task 4 explores scientific web discourse processing. These tasks present challenging classification and retrieval problems at both the document and span levels, including multilingual settings.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes