Composer's Assistant: An Interactive Transformer for Multi-Track MIDI Infilling
This work addresses the need for interactive human-computer composition tools in digital audio workstations, though it is incremental as it applies an existing model type to a specific domain task.
The paper tackles the problem of multi-track MIDI infilling in interactive music composition by training a T5-like model to fill deleted track-measures, and results include objective and subjective tests with the release of a complete system including source code and pretrained models.
We introduce Composer's Assistant, a system for interactive human-computer composition in the REAPER digital audio workstation. We consider the task of multi-track MIDI infilling when arbitrary track-measures have been deleted from a contiguous slice of measures from a MIDI file, and we train a T5-like model to accomplish this task. Composer's Assistant consists of this model together with scripts that enable interaction with the model in REAPER. We conduct objective and subjective tests of our model. We release our complete system, consisting of source code, pretrained models, and REAPER scripts. Our models were trained only on permissively-licensed MIDI files.