MusicGen-Chord: Advancing Music Generation through Chord Progressions and Interactive Web-UI
This work addresses the need for more controllable and accessible AI music generation tools for users, though it is incremental as it builds on an existing model.
The paper tackles the problem of generating music that aligns with chord progressions and textual descriptions by extending the MusicGen language model to incorporate chord features, resulting in a model that can produce music conditioned on both elements and an interactive web application for remixing.
MusicGen is a music generation language model (LM) that can be conditioned on textual descriptions and melodic features. We introduce MusicGen-Chord, which extends this capability by incorporating chord progression features. This model modifies one-hot encoded melody chroma vectors into multi-hot encoded chord chroma vectors, enabling the generation of music that reflects both chord progressions and textual descriptions. Furthermore, we developed MusicGen-Remixer, an application utilizing MusicGen-Chord to generate remixes of input music conditioned on textual descriptions. Both models are integrated into Replicate's web-UI using cog, facilitating broad accessibility and user-friendly controllable interaction for creating and experiencing AI-generated music.