HCApr 20

Conversational AI increases political knowledge as effectively as self-directed internet search

arXiv:2509.0521931.57 citationsh-index: 11
Predicted impact top 4% in HC · last 90 daysOriginality Incremental advance
AI Analysis

This study addresses concerns about conversational AI distorting public opinion by demonstrating that its use for political information-seeking does not increase belief in misinformation compared to traditional search, providing evidence for policymakers and the public.

A national survey found that 32% of chatbot users (13% of eligible UK voters) used conversational AI for political information before the 2024 election. Randomized controlled trials (N=2,858) showed that conversational AI increases political knowledge (increases belief in true information and decreases belief in misinformation) as effectively as self-directed Google search across multiple topics, models, and prompting strategies.

Conversational AI systems are increasingly being used in place of traditional search engines to help users complete information-seeking tasks. This has raised concerns in the political domain, where biased or hallucinated outputs could misinform voters or distort public opinion. However, in spite of these concerns, the extent to which conversational AI is used for political information-seeking, as well the potential impact of this use on users' political knowledge, remains uncertain. Here, we address these questions: First, in a representative national survey of the UK public (N = 2,499), we find that in the week before the 2024 election as many as 32% of chatbot users - and 13% of eligible UK voters - have used conversational AI to seek political information relevant to their electoral choice. Second, in a series of randomised controlled trials (N = 2,858 total) we find that across issues, models, and prompting strategies, task-directed conversations with AI to research specific political topics increase political knowledge (increase belief in true information and decrease belief in misinformation) to the same extent as self-directed Google search. Taken together, our results suggest that people in the UK are increasingly turning to conversational AI for information about politics. These findings substantially extend prior work by demonstrating that conversational AI's effects on political knowledge generalise across multiple topics, political perspectives, and model families, suggesting that the shift toward AI-assisted political information-seeking may not lead to increased public belief in political misinformation.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes