Can AI Explanations Make You Change Your Mind?
This addresses the problem of ensuring effective human oversight in AI systems for users, but it is incremental as it builds on existing research about trust and explanations.
The study investigated whether AI explanations in decision support systems lead users to reconsider their decisions, finding that participants often spent little time on explanations and did not always consider them in detail.
In the context of AI-based decision support systems, explanations can help users to judge when to trust the AI's suggestion, and when to question it. In this way, human oversight can prevent AI errors and biased decision-making. However, this rests on the assumption that users will consider explanations in enough detail to be able to catch such errors. We conducted an online study on trust in explainable DSS, and were surprised to find that in many cases, participants spent little time on the explanation and did not always consider it in detail. We present an exploratory analysis of this data, investigating what factors impact how carefully study participants consider AI explanations, and how this in turn impacts whether they are open to changing their mind based on what the AI suggests.