DeformTune: A Deformable XAI Music Prototype for Non-Musicians
This addresses making AI music systems more explainable and empowering for novice users, but it is incremental as it builds on existing models and provides preliminary insights.
The paper tackled the problem of AI music generation tools being inaccessible to non-musicians due to complex interfaces, by introducing DeformTune, a prototype combining a tactile deformable interface with the MeasureVAE model, and found in a study with 11 participants that users faced challenges like unclear control mappings and limited expressive range.
Many existing AI music generation tools rely on text prompts, complex interfaces, or instrument-like controls, which may require musical or technical knowledge that non-musicians do not possess. This paper introduces DeformTune, a prototype system that combines a tactile deformable interface with the MeasureVAE model to explore more intuitive, embodied, and explainable AI interaction. We conducted a preliminary study with 11 adult participants without formal musical training to investigate their experience with AI-assisted music creation. Thematic analysis of their feedback revealed recurring challenge--including unclear control mappings, limited expressive range, and the need for guidance throughout use. We discuss several design opportunities for enhancing explainability of AI, including multimodal feedback and progressive interaction support. These findings contribute early insights toward making AI music systems more explainable and empowering for novice users.