When Hate Meets Facts: LLMs-in-the-Loop for Check-worthiness Detection in Hate Speech
This addresses the challenge for content moderators and researchers in handling hate speech with fact-like claims, though it is incremental in combining existing concepts.
The paper tackles the problem of hate speech combined with misinformation by introducing a dataset (WSF-ARG+) and an LLM-in-the-loop framework for check-worthiness detection, showing that this approach reduces human annotation effort and improves hate speech detection by up to 0.213 macro-F1.
Hateful content online is often expressed using fact-like, not necessarily correct information, especially in coordinated online harassment campaigns and extremist propaganda. Failing to jointly address hate speech (HS) and misinformation can deepen prejudice, reinforce harmful stereotypes, and expose bystanders to psychological distress, while polluting public debate. Moreover, these messages require more effort from content moderators because they must assess both harmfulness and veracity, i.e., fact-check them. To address this challenge, we release WSF-ARG+, the first dataset which combines hate speech with check-worthiness information. We also introduce a novel LLM-in-the-loop framework to facilitate the annotation of check-worthy claims. We run our framework, testing it with 12 open-weight LLMs of different sizes and architectures. We validate it through extensive human evaluation, and show that our LLM-in-the-loop framework reduces human effort without compromising the annotation quality of the data. Finally, we show that HS messages with check-worthy claims show significantly higher harassment and hate, and that incorporating check-worthiness labels improves LLM-based HS detection up to 0.213 macro-F1 and to 0.154 macro-F1 on average for large models.