HpRNet : Incorporating Residual Noise Modeling for Violin in a Variational Parametric Synthesizer
This work addresses the challenge of achieving natural tone quality in violin synthesis for music production and audio synthesis applications, but it is incremental as it builds on existing parametric methods.
The paper tackled the problem of synthesizing realistic violin tones by modeling residual bow noise, resulting in a parametric synthesizer that improves naturalness through insights from harmonic and residual component analysis.
Generative Models for Audio Synthesis have been gaining momentum in the last few years. More recently, parametric representations of the audio signal have been incorporated to facilitate better musical control of the synthesized output. In this work, we investigate a parametric model for violin tones, in particular the generative modeling of the residual bow noise to make for more natural tone quality. To aid in our analysis, we introduce a dataset of Carnatic Violin Recordings where bow noise is an integral part of the playing style of higher pitched notes in specific gestural contexts. We obtain insights about each of the harmonic and residual components of the signal, as well as their interdependence, via observations on the latent space derived in the course of variational encoding of the spectral envelopes of the sustained sounds.