AIive: Interactive Visualization and Sonification of Neural Networks in Virtual Reality
This provides an artistic and intuitive way to engage a wide audience with AI, though it is incremental in combining existing visualization and sonification techniques in VR.
The paper tackles the problem of representing AI as more than just a tool by introducing AIive, an interactive VR system that visualizes and sonifies neural networks, allowing users to manipulate parameters with virtual hands and receive real-time auditory feedback on metrics like loss and accuracy.
Artificial Intelligence (AI), especially Neural Networks (NNs), has become increasingly popular. However, people usually treat AI as a tool, focusing on improving outcome, accuracy, and performance while paying less attention to the representation of AI itself. We present AIive, an interactive visualization of AI in Virtual Reality (VR) that brings AI "alive". AIive enables users to manipulate the parameters of NNs with virtual hands and provides auditory feedback for the real-time values of loss, accuracy, and hyperparameters. Thus, AIive contributes an artistic and intuitive way to represent AI by integrating visualization, sonification, and direct manipulation in VR, potentially targeting a wide range of audiences.