Artificial Artificial Intelligence: Measuring Influence of AI 'Assessments' on Moral Decision-Making
This addresses the problem of AI's impact on ethical decisions for policymakers and developers, though it is incremental in exploring feedback mechanisms.
The study investigated how feedback from AI, even when random, influences moral decision-making in kidney allocation scenarios, finding that AI feedback can sway judgments differently than human expert feedback.
Given AI's growing role in modeling and improving decision-making, how and when to present users with feedback is an urgent topic to address. We empirically examined the effect of feedback from false AI on moral decision-making about donor kidney allocation. We found some evidence that judgments about whether a patient should receive a kidney can be influenced by feedback about participants' own decision-making perceived to be given by AI, even if the feedback is entirely random. We also discovered different effects between assessments presented as being from human experts and assessments presented as being from AI.