Game AI Not Fun? A Scoping Review and Meta-Analysis on the Differences in Enjoyment between Human and Computer Opponents
For game developers and AI researchers, this quantifies the enjoyment gap between human and computer opponents, highlighting a need to address this penalty to improve player engagement.
This scoping review and meta-analysis of 20 studies found a statistically significant, medium-to-large pooled effect size showing that players enjoy games less when competing against computer opponents compared to human opponents, indicating a psychological penalty for AI opponents.
Although advancements in game character AI aim to enhance player engagement, evidence suggests that perceiving an opponent as artificial can diminish the psychological experience. This paper presents a scoping review and meta-analysis of empirical studies focusing on player enjoyment when competing against human versus computer opponents. First, the scoping review was conducted to map the landscape of 20 included studies, detailing their study designs, outcome measures, and research foci. Second, a three-level meta-analysis synthesizing baseline comparisons from nine studies quantitatively assesses the differences in enjoyment. The results demonstrate a statistically significant, medium-to-large pooled effect size, indicating a psychological penalty in computer-opponent conditions. This paper provides a comprehensive overview of the extant knowledge on this topic, and underscores the necessity for further research in order to fully understand and resolve the penalty of the computer opponent context.