Visualizing Deep Neural Networks with Topographic Activation Maps
This addresses the explainability issue in DNNs for users of machine learning systems, though it is incremental as it adapts existing methods from neuroscience.
The paper tackles the problem of understanding deep neural networks (DNNs) by adapting neuroscience methods to visualize neuron activations as topographic maps, resulting in a technique that improves transparency and is interpretable without expert knowledge.
Machine Learning with Deep Neural Networks (DNNs) has become a successful tool in solving tasks across various fields of application. However, the complexity of DNNs makes it difficult to understand how they solve their learned task. To improve the explainability of DNNs, we adapt methods from neuroscience that analyze complex and opaque systems. Here, we draw inspiration from how neuroscience uses topographic maps to visualize brain activity. To also visualize activations of neurons in DNNs as topographic maps, we research techniques to layout the neurons in a two-dimensional space such that neurons of similar activity are in the vicinity of each other. In this work, we introduce and compare methods to obtain a topographic layout of neurons in a DNN layer. Moreover, we demonstrate how to use topographic activation maps to identify errors or encoded biases and to visualize training processes. Our novel visualization technique improves the transparency of DNN-based decision-making systems and is interpretable without expert knowledge in Machine Learning.