Go witheFlow: Real-time Emotion Driven Audio Effects Modulation
This addresses the challenge of human-machine collaboration in music performance for performers and developers, but it is incremental as it builds on existing emotion-driven modulation concepts.
The paper tackles the problem of enhancing real-time music performance by introducing the witheFlow system, which automatically modulates audio effects based on biosignals and audio features, resulting in a lightweight, open-source proof-of-concept that runs locally on a laptop.
Music performance is a distinctly human activity, intrinsically linked to the performer's ability to convey, evoke, or express emotion. Machines cannot perform music in the human sense; they can produce, reproduce, execute, or synthesize music, but they lack the capacity for affective or emotional experience. As such, music performance is an ideal candidate through which to explore aspects of collaboration between humans and machines. In this paper, we introduce the witheFlow system, designed to enhance real-time music performance by automatically modulating audio effects based on features extracted from both biosignals and the audio itself. The system, currently in a proof-of-concept phase, is designed to be lightweight, able to run locally on a laptop, and is open-source given the availability of a compatible Digital Audio Workstation and sensors.