XDeep: An Interpretation Tool for Deep Neural Networks
This tool addresses the need for interpretability in deep learning for practitioners and researchers, but it is incremental as it integrates existing methods into a unified package.
The authors introduced XDeep, an open-source Python package that provides interpretations for deep neural networks using various state-of-the-art algorithms, enabling users to easily generate and compare local and global explanations with minimal code.
XDeep is an open-source Python package developed to interpret deep models for both practitioners and researchers. Overall, XDeep takes a trained deep neural network (DNN) as the input, and generates relevant interpretations as the output with the post-hoc manner. From the functionality perspective, XDeep integrates a wide range of interpretation algorithms from the state-of-the-arts, covering different types of methodologies, and is capable of providing both local explanation and global explanation for DNN when interpreting model behaviours. With the well-documented API designed in XDeep, end-users can easily obtain the interpretations for their deep models at hand with several lines of codes, and compare the results among different algorithms. XDeep is generally compatible with Python 3, and can be installed through Python Package Index (PyPI). The source codes are available at: https://github.com/datamllab/xdeep.