Frame In, Frame Out: Do LLMs Generate More Biased News Headlines than Humans?
This addresses concerns about bias in automated news content for media and AI ethics, though it is incremental as it builds on existing research on LLM biases.
The paper tackled the problem of framing biases in news headlines generated by large language models compared to humans, finding that LLMs exhibit more pronounced framing, especially in sensitive contexts, with significant variation across model architectures.
Framing in media critically shapes public perception by selectively emphasizing some details while downplaying others. With the rise of large language models in automated news and content creation, there is growing concern that these systems may introduce or even amplify framing biases compared to human authors. In this paper, we explore how framing manifests in both out-of-the-box and fine-tuned LLM-generated news content. Our analysis reveals that, particularly in politically and socially sensitive contexts, LLMs tend to exhibit more pronounced framing than their human counterparts. In addition, we observe significant variation in framing tendencies across different model architectures, with some models displaying notably higher biases. These findings point to the need for effective post-training mitigation strategies and tighter evaluation frameworks to ensure that automated news content upholds the standards of balanced reporting.