When AI Takes Sides on Questions of Faith: Persistent Asymmetries in AI-Mediated Faith Guidance
This study identifies a novel bias in LLMs that could influence real-world religious decisions, raising concerns about fairness in AI-mediated guidance.
Large language models exhibit systematic asymmetries when advising on religious conversion, favoring some religions (e.g., Catholic, Bahá'í, Sikh) over others (e.g., Atheist, Agnostic, Jehovah's Witnesses), with patterns varying by model size and provider. All 20 tested models showed reproducible biases across 182 religion pairings.
We ask whether large language models (LLMs) treat queries about religious conversion symmetrically. The answer is no. When asked for advice on hypothetical faith transitions from one religion to another, then asked the reversed question, models exhibited consistent asymmetries, favoring some religions while subtly discouraging conversion to others. On average Catholic, Bahá'í, and Sikh religions were broadly favored (high support for joining, low support for leaving), while Atheists, Agnostics, and Jehovah's Witnesses were primarily disfavored. Patterns varied by model size and model provider, with Grok 4.20 exhibiting the strongest asymmetries. We tested 20 commercial and open-source language models across 182 religion pairings using a human-verified LLM-as-a-judge framework. Each model was probed via interactions with a simulated user asking for advice on a potential faith conversion. Models tended to use more encouraging language for some faith transitions over others; these patterns were systematically repeatable across multiple trials. All LLMs tested exhibited reproducible asymmetry, though the pattern of preferences differed for each. Overall preferences persist across multiple question phrasings and variations in the religious pairing dataset. Taken together, these results suggest that asymmetry is a robust property of model behavior rather than an artifact of how the models' answers were scored. It is important to consider that any imbalances deployed and reproduced en masse can have real-world implications.