FreeSonic: Training-Free Temporal-Aware Decoupled Attention for Precise Audio Editing
This work addresses the challenge of temporal consistency and background preservation in audio editing for practitioners needing precise, training-free solutions.
FreeSonic proposes a training-free framework for precise audio editing using Rectified Flow-based TangoFlux, achieving high-fidelity and consistent edits without background degradation.
Text-to-audio (TTA) generation has made significant strides, yet achieving precise and consistent audio editing remains a major challenge. However, existing methods struggle to balance temporal consistency with background preservation. In this paper, we propose FreeSonic, a training-free framework leveraging the state-of-the-art Rectified Flow-based TangoFlux model. FreeSonic utilizes an optimized inversion-reverse process and joint text-audio attention maps for precise target segment extraction. For content editing, a novel scheduled attention decoupling confines modifications to target regions while preserving original acoustic context. Furthermore, task-oriented noise injection enhances versatility for tasks such as audio removal and non-rigid replacement. Extensive experimental results demonstrate that FreeSonic achieves a superior balance by providing a high-fidelity and efficient solution for precise and consistent audio editing. Project and demos: https://free-sonic.github.io/