SIAIOct 24, 2024

The Stepwise Deception: Simulating the Evolution from True News to Fake News with LLM Agents

arXiv:2410.19064v221 citationsh-index: 12EMNLP
Originality Incremental advance
AI Analysis

This addresses the need for early detection and prevention of misinformation online, though it is incremental as it builds on existing LLM and simulation methods for a specific domain.

The paper tackles the problem of how true news gradually evolves into fake news by proposing FUSE, a Large Language Model-based simulation framework that models social interactions with distinct agent types to capture distortion patterns, and results show it effectively reproduces known fake news and aligns with human evaluations.

With the growing spread of misinformation online, understanding how true news evolves into fake news has become crucial for early detection and prevention. However, previous research has often assumed fake news inherently exists rather than exploring its gradual formation. To address this gap, we propose FUSE (Fake news evolUtion Simulation framEwork), a novel Large Language Model (LLM)-based simulation approach explicitly focusing on fake news evolution from real news. Our framework model a social network with four distinct types of LLM agents commonly observed in daily interactions: spreaders who propagate information, commentators who provide interpretations, verifiers who fact-check, and bystanders who observe passively to simulate realistic daily interactions that progressively distort true news. To quantify these gradual distortions, we develop FUSE-EVAL, a comprehensive evaluation framework measuring truth deviation along multiple linguistic and semantic dimensions. Results show that FUSE effectively captures fake news evolution patterns and accurately reproduces known fake news, aligning closely with human evaluations. Experiments demonstrate that FUSE accurately reproduces known fake news evolution scenarios, aligns closely with human judgment, and highlights the importance of timely intervention at early stages. Our framework is extensible, enabling future research on broader scenarios of fake news.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes