Do You Trust ChatGPT? -- Perceived Credibility of Human and AI-Generated Content
This highlights a potential risk for users in evaluating AI-generated information, calling for more critical thinking, though it is incremental as it builds on existing research about AI trust.
The study investigated how people perceive the credibility of content from human authors versus AI-generated content like ChatGPT, finding that participants attributed similar credibility levels regardless of interface, with AI content rated as clearer and more engaging.
This paper examines how individuals perceive the credibility of content originating from human authors versus content generated by large language models, like the GPT language model family that powers ChatGPT, in different user interface versions. Surprisingly, our results demonstrate that regardless of the user interface presentation, participants tend to attribute similar levels of credibility. While participants also do not report any different perceptions of competence and trustworthiness between human and AI-generated content, they rate AI-generated content as being clearer and more engaging. The findings from this study serve as a call for a more discerning approach to evaluating information sources, encouraging users to exercise caution and critical thinking when engaging with content generated by AI systems.