SDAICVLGASSep 8, 2024

Attention-Based Efficient Breath Sound Removal in Studio Audio Recordings

arXiv:2409.04949v11 citationsh-index: 1
Originality Incremental advance
AI Analysis

This addresses a time-intensive and expertise-heavy task for sound engineers, offering an efficient and precise automated solution, though it appears incremental as it builds on existing attention U-Net architectures.

The paper tackles the problem of automatically detecting and removing breath sounds in studio audio recordings, achieving superior accuracy with only 1.9M parameters and a training time of 3.2 hours, which is significantly less than top-performing models.

In this research, we present an innovative, parameter-efficient model that utilizes the attention U-Net architecture for the automatic detection and eradication of non-speech vocal sounds, specifically breath sounds, in vocal recordings. This task is of paramount importance in the field of sound engineering, despite being relatively under-explored. The conventional manual process for detecting and eliminating these sounds requires significant expertise and is extremely time-intensive. Existing automated detection and removal methods often fall short in terms of efficiency and precision. Our proposed model addresses these limitations by offering a streamlined process and superior accuracy, achieved through the application of advanced deep learning techniques. A unique dataset, derived from Device and Produced Speech (DAPS), was employed for this purpose. The training phase of the model emphasizes a log spectrogram and integrates an early stopping mechanism to prevent overfitting. Our model not only conserves precious time for sound engineers but also enhances the quality and consistency of audio production. This constitutes a significant breakthrough, as evidenced by its comparative efficiency, necessitating only 1.9M parameters and a training duration of 3.2 hours - markedly less than the top-performing models in this domain. The model is capable of generating identical outputs as previous models with drastically improved precision, making it an optimal choice.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes