Efficient and Microphone-Fault-Tolerant 3D Sound Source Localization
This work improves SSL for deployment in dynamic or resource-constrained environments, though it appears incremental in balancing performance and efficiency.
The paper tackles the problem of 3D sound source localization by addressing high computational costs and calibration requirements, introducing a framework that achieves accurate and efficient localization with fewer microphones and fault tolerance to unreliable inputs.
Sound source localization (SSL) is a critical technology for determining the position of sound sources in complex environments. However, existing methods face challenges such as high computational costs and precise calibration requirements, limiting their deployment in dynamic or resource-constrained environments. This paper introduces a novel 3D SSL framework, which uses sparse cross-attention, pretraining, and adaptive signal coherence metrics, to achieve accurate and computationally efficient localization with fewer input microphones. The framework is also fault-tolerant to unreliable or even unknown microphone position inputs, ensuring its applicability in real-world scenarios. Preliminary experiments demonstrate its scalability for multi-source localization without requiring additional hardware. This work advances SSL by balancing the model's performance and efficiency and improving its robustness for real-world scenarios.