6.0CLMay 16
PluRule: A Benchmark for Moderating Pluralistic Communities on Social MediaZoher Kachwala, Bao Tran Truong, Rasika Muralidharan et al.
Social media are shifting towards pluralism -- community-governed platforms where groups define their own norms. What violates rules in one community may be perfectly acceptable in another. Can AI models help moderate such pluralistic communities? We formalize the task as a multiple-choice problem, mirroring how human moderators operate in the real world: given a comment and its surrounding context, identify which specific rule, if any, is violated. We introduce PluRule, a multimodal, multilingual benchmark for detecting 13,371 rule violations across 1,989 Reddit communities spanning 2,885 rules in 9 languages. Using this benchmark, we show that state-of-the-art vision-language models struggle significantly: even GPT-5.2 with high reasoning performs only slightly better than a trivial baseline. We also find that bigger models and increased context provide marginal gains, and universal rules like civility and self-promotion are easier to detect. Our results show that moderation of pluralistic communities on social media is a fundamental challenge for language models. Our code and benchmark are publicly available.
7.4SIJun 3
Federating Governance: How Community Rules Scale with Mastodon InstancesRasika Muralidharan, Yong-Yeol Ahn, Bao Tran Truong
The rise of decentralized social media platforms like Mastodon and Bluesky highlights the challenge of scaling self-governance and moderation. As communities grow, they face new issues that demand increasingly complex governance structures. However, as moderation is mainly volunteer-driven, there is limited formal guidance on how community rules and moderation practices should evolve with growth. This study investigates how moderation scale with Mastodon instances by analyzing community rules across servers of varying sizes. We categorize these rules to identify key governance priorities and find that these priorities are remarkably consistent across instance sizes: rules addressing problematic content, such as harassment, hate speech, and illegal content, dominate regardless of scale. While smaller communities focus on narrower sets of topics, larger servers maintain a more balanced coverage of a broad range of topics. Our analysis of rule formalization reveals that community size strongly predicts rule development. As instances grow, their rules become more extensive and topically diverse, but also exhibit lower readability and linguistic diversity. In contrast, external federation interactions have a limited role, mainly associated with a broader scope of rules without substantially affecting their diversity or form. These findings highlight the relative influence of internal versus external factors, suggesting that local scaling pressures outweigh network-level dynamics in decentralized social media governance. The scaling pattern observed on Mastodon resemble those previously identified on centralized platforms such as Reddit, suggesting that community size imposes fundamental constraints on self-governance that transcend platform architectures
4.0SIJun 14
Challenging Partisan Expectations Reduces Political PolarizationDo Won Kim, Ozgur Can Seckin, Saumya Bhadani et al.
Political conversations are often proposed as a remedy for political polarization, yet their effectiveness remains inconsistent. We argue that this inconsistency partly reflects a neglected feature of political contact: the expectations partisans bring to these encounters. We hypothesize that conversations should reduce political polarization the most when they violate the expected link between partisan identity and issue position. We test this hypothesis in a 2x2 experiment in which 1,983 U.S. adults engaged in structured conversations with an AI chatbot whose presented partisan identity and policy stance were independently manipulated. We find that expectation-challenging conversations in which participants talk with a disagreeing ingroup member or an agreeing outgroup member are effective in reducing affective and issue polarization. Although these effects emerge without meaningful shifts in participants' own policy positions, a follow-up survey shows that most effects disappear over one month. Interestingly, these conversations maintain or improve objective measures of deliberation but are experienced as less satisfying by participants. Our findings identify expectation violation as an underexplored depolarization mechanism. Our results also demonstrate the promises and limitations of how conversational AI can serve as a scalable method for experimentally studying interventions to mitigating partisan divides.