Polyphonic Music Generation by Modeling Temporal Dependencies Using a RNN-DBN
This work addresses the problem of generating complex polyphonic music sequences for applications in music composition and AI creativity, presenting an incremental improvement by hybridizing existing methods.
The authors tackled polyphonic music generation by proposing RNN-DBN, a model combining recurrent neural networks and Deep Belief Networks to capture temporal dependencies and high-level data representations, resulting in a technique capable of more complex data representation than using Restricted Boltzmann Machines alone.
In this paper, we propose a generic technique to model temporal dependencies and sequences using a combination of a recurrent neural network and a Deep Belief Network. Our technique, RNN-DBN, is an amalgamation of the memory state of the RNN that allows it to provide temporal information and a multi-layer DBN that helps in high level representation of the data. This makes RNN-DBNs ideal for sequence generation. Further, the use of a DBN in conjunction with the RNN makes this model capable of significantly more complex data representation than an RBM. We apply this technique to the task of polyphonic music generation.