Position: Anthropomorphic Misalignment Research Needs Stronger Evidence
For AI safety researchers and policymakers, this paper highlights the need for stronger evidence in AMR to ensure reliable safety decisions.
This position paper argues that many Anthropomorphic Misalignment Research (AMR) studies lack robust evidence, leading to overinterpretation of model behaviors. It proposes a framework of evidence levels and a diagnostic checklist to improve methodological rigor.
We argue that many Anthropomorphic Misalignment Research (AMR) studies need stronger evidence to ensure that they can provide a robust foundation for critical safety decisions, such as model deployment and regulation. By evaluating failure modes across different misalignment concepts, such as deception, emergent misalignment, and sycophancy, we show how conceptual ambiguity, non-robust datasets, experimental design, and insufficient causal interventions can lead to overinterpretation of model behaviors. This position paper aims to offer guidance on evidentiary considerations that can help improve methodological rigor in AMR. To achieve this, we provide a clear call to action through a proposed framework of evidence levels and a diagnostic checklist. These shared standards will enable more productive scientific discourse and ensure that claims about AI risks rest on solid empirical foundations.