Genetic Soundtracks: Creative Matching of Audio to Video
This addresses the challenge of enhancing engagement and aesthetic quality in movies or videos through creative soundtrack matching, but it appears incremental as it applies existing evolutionary methods to a specific domain.
The paper tackles the problem of creatively matching audio to video by proposing Genetic Soundtracks, an evolutionary approach that uses genetic algorithms to truncate, combine, and adjust audio clips based on content features, resulting in novel and subtly different solutions for each generation.
The matching of the soundtrack in a movie or a video can have an enormous influence in the message being conveyed and its impact, in the sense of involvement and engagement, and ultimately in their aesthetic and entertainment qualities. Art is often associated with creativity, implying the presence of inspiration, originality and appropriateness. Evolutionary systems provides us with the novelty, showing us new and subtly different solutions in every generation, possibly stimulating the creativity of the human using the system. In this paper, we present Genetic Soundtracks, an evolutionary approach to the creative matching of audio to a video. It analyzes both media to extract features based on their content, and adopts genetic algorithms, with the purpose of truncating, combining and adjusting audio clips, to align and match them with the video scenes.