The Gray Area: Characterizing Moderator Disagreement on Reddit
This addresses the problem of inconsistent content moderation for online platform administrators and moderators, though it is incremental in characterizing existing challenges.
The study analyzed 4.3 million moderation log entries from 24 subreddits over 5 years, finding that one-in-seven moderation cases involve disagreements among moderators, particularly in ambiguous situations like trolling and brigading, and that state-of-the-art language models struggle to adjudicate these disputed cases.
Volunteer moderators play a crucial role in sustaining online dialogue, but they often disagree about what should or should not be allowed. In this paper, we study the complexity of content moderation with a focus on disagreements between moderators, which we term the ``gray area'' of moderation. Leveraging 5 years and 4.3 million moderation log entries from 24 subreddits of different topics and sizes, we characterize how gray area, or disputed cases, differ from undisputed cases. We show that one-in-seven moderation cases are disputed among moderators, often addressing transgressions where users' intent is not directly legible, such as in trolling and brigading, as well as tensions around community governance. This is concerning, as almost half of all gray area cases involved automated moderation decisions. Through information-theoretic evaluations, we demonstrate that gray area cases are inherently harder to adjudicate than undisputed cases and show that state-of-the-art language models struggle to adjudicate them. We highlight the key role of expert human moderators in overseeing the moderation process and provide insights about the challenges of current moderation processes and tools.