Aligning Characteristic Descriptors with Images for Human-Expert-like Explainability
This addresses the need for more transparent and trustworthy AI in critical applications like law enforcement and medical diagnosis, though it appears incremental as it builds on concept bottleneck methods.
The paper tackles the problem of generating human-expert-like explanations for deep learning models in mission-critical domains like law enforcement and medical diagnosis, proposing a method that uses characteristic descriptors to identify their presence in images and demonstrating improved explainability over existing techniques in face recognition and chest X-ray diagnosis.
In mission-critical domains such as law enforcement and medical diagnosis, the ability to explain and interpret the outputs of deep learning models is crucial for ensuring user trust and supporting informed decision-making. Despite advancements in explainability, existing methods often fall short in providing explanations that mirror the depth and clarity of those given by human experts. Such expert-level explanations are essential for the dependable application of deep learning models in law enforcement and medical contexts. Additionally, we recognize that most explanations in real-world scenarios are communicated primarily through natural language. Addressing these needs, we propose a novel approach that utilizes characteristic descriptors to explain model decisions by identifying their presence in images, thereby generating expert-like explanations. Our method incorporates a concept bottleneck layer within the model architecture, which calculates the similarity between image and descriptor encodings to deliver inherent and faithful explanations. Through experiments in face recognition and chest X-ray diagnosis, we demonstrate that our approach offers a significant contrast over existing techniques, which are often limited to the use of saliency maps. We believe our approach represents a significant step toward making deep learning systems more accountable, transparent, and trustworthy in the critical domains of face recognition and medical diagnosis.