MIDI-Draw: Sketching to Control Melody Generation
This addresses the need for more accessible music creation tools for users without prior musical knowledge, though it is incremental as it builds on existing controllable melody generation methods.
The paper tackles the problem of making melody generation more intuitive by allowing users to sketch melodic contours instead of using static parameters, resulting in a proof-of-principle system that enables quick specification of parameter changes over time.
We describe a proof-of-principle implementation of a system for drawing melodies that abstracts away from a note-level input representation via melodic contours. The aim is to allow users to express their musical intentions without requiring prior knowledge of how notes fit together melodiously. Current approaches to controllable melody generation often require users to choose parameters that are static across a whole sequence, via buttons or sliders. In contrast, our method allows users to quickly specify how parameters should change over time by drawing a contour.