What is Human in Judgment? Testing Automation Bias and Algorithm Aversion Among United States Military Academy Cadets
This addresses concerns about AI's role in military decision-making, suggesting military training may mitigate risks, though it is incremental as it builds on existing theories with limited evidence.
The study tested automation bias and algorithm aversion among U.S. Military Academy cadets compared to the general public, finding that cadets showed better calibrated trust in AI decision-support systems, with less cognitive distortion than civilians.
Human judgment has always been central to conflict and escalation, but how will a world of artificial intelligence (AI) change the role of humans in war? As militaries increasingly adopt AI-enabled decision-support systems (DSS), including the United States in the war against Iran, concerns about automation bias -- over-reliance on algorithmic recommendations -- and algorithm aversion -- premature distrust of automated outputs -- raise fears that relying on AI too much could increase the risk of error, miscalculation, and accidents. Yet existing evidence on how militaries actually interact with AI remains limited. We test theories about the susceptibility of militaries to automation bias by comparing the results from a survey experiment conducted with 236 cadets at the United States Military Academy at West Point to a demographically similar cross-national public sample. Respondents completed a target identification task and then received advice from either an algorithm or a human analyst and had the opportunity to re-assess their initial identification, allowing direct measurement of automation bias and algorithm aversion. Contrary to prominent concerns, we find that West Point cadets are less prone to cognitive distortion than members of the general public, displaying better calibrated trust in algorithmic decision support systems. While the findings are limited, they suggest that military education and exposure to AI can meaningfully shape how AI influences international politics in matters of war and peace.