Towards Relatable Explainable AI with the Perceptual Process
This work addresses the need for more interpretable explainable AI in perception applications, but it is incremental as it builds on existing contrastive explanation methods.
The paper tackled the problem of making contrastive explanations in AI more relatable by proposing a framework inspired by cognitive psychology, and found that counterfactual explanations with semantic cues were useful in vocal emotion recognition, though saliency explanations were not.
Machine learning models need to provide contrastive explanations, since people often seek to understand why a puzzling prediction occurred instead of some expected outcome. Current contrastive explanations are rudimentary comparisons between examples or raw features, which remain difficult to interpret, since they lack semantic meaning. We argue that explanations must be more relatable to other concepts, hypotheticals, and associations. Inspired by the perceptual process from cognitive psychology, we propose the XAI Perceptual Processing Framework and RexNet model for relatable explainable AI with Contrastive Saliency, Counterfactual Synthetic, and Contrastive Cues explanations. We investigated the application of vocal emotion recognition, and implemented a modular multi-task deep neural network to predict and explain emotions from speech. From think-aloud and controlled studies, we found that counterfactual explanations were useful and further enhanced with semantic cues, but not saliency explanations. This work provides insights into providing and evaluating relatable contrastive explainable AI for perception applications.