Not All Transparency Is Equal: Source Presentation Effects on Attention, Interaction, and Persuasion in Conversational Search
This research addresses the problem of optimizing source presentation for user engagement in conversational search systems, but it is incremental as it builds on existing work on transparency and interface design.
The study investigated how different source presentation formats in conversational search systems affect user engagement, finding that high-visibility interfaces increased hovering but not clicking, and initially reduced knowledge gain and interest, though these improved with more source usage, while sidebars uniquely increased agreement changes.
Conversational search systems increasingly provide source citations, yet how citation or source presentation formats influence user engagement remains unclear. We conducted a crowdsourcing user experiment with 394 participants comparing four source presentation designs that varied citation visibility and accessibility: collapsible lists, hover cards, footer lists, and aligned sidebars.High-visibility interfaces generated substantially more hovering on sources, though clicking remained infrequent across all conditions. While interface design showed limited effects on user experience and perception measures, it significantly influenced knowledge, interest, and agreement changes. High-visibility interfaces initially reduced knowledge gain and interest, but these positive effects emerged with increasing source usage. The sidebar condition uniquely increased agreement change. Our findings demonstrate that source presentation alone may not enhance engagement and can even reduce it when insufficient sources are provided.