Interpret the Predictions of Deep Networks via Re-Label Distillation
This work addresses the need for reliability in deploying deep networks by providing more intuitive explanations for their predictions, though it appears incremental in the field of interpretability.
The paper tackles the problem of interpreting black-box deep network predictions by proposing a re-label distillation approach that learns a direct map from input to prediction using self-supervision, with experiments verifying its effectiveness both qualitatively and quantitatively.
Interpreting the predictions of a black-box deep network can facilitate the reliability of its deployment. In this work, we propose a re-label distillation approach to learn a direct map from the input to the prediction in a self-supervision manner. The image is projected into a VAE subspace to generate some synthetic images by randomly perturbing its latent vector. Then, these synthetic images can be annotated into one of two classes by identifying whether their labels shift. After that, using the labels annotated by the deep network as teacher, a linear student model is trained to approximate the annotations by mapping these synthetic images to the classes. In this manner, these re-labeled synthetic images can well describe the local classification mechanism of the deep network, and the learned student can provide a more intuitive explanation towards the predictions. Extensive experiments verify the effectiveness of our approach qualitatively and quantitatively.