Improving speaker de-identification with functional data analysis of f0 trajectories
This work addresses voice privacy concerns, particularly for under-resourced languages, by enhancing speaker de-identification methods.
The paper tackles the problem of speaker de-identification in speech data by introducing a method that manipulates f0 trajectories using functional data analysis, improving formant-based de-identification by up to 25%.
Due to a constantly increasing amount of speech data that is stored in different types of databases, voice privacy has become a major concern. To respond to such concern, speech researchers have developed various methods for speaker de-identification. The state-of-the-art solutions utilize deep learning solutions which can be effective but might be unavailable or impractical to apply for, for example, under-resourced languages. Formant modification is a simpler, yet effective method for speaker de-identification which requires no training data. Still, remaining intonational patterns in formant-anonymized speech may contain speaker-dependent cues. This study introduces a novel speaker de-identification method, which, in addition to simple formant shifts, manipulates f0 trajectories based on functional data analysis. The proposed speaker de-identification method will conceal plausibly identifying pitch characteristics in a phonetically controllable manner and improve formant-based speaker de-identification up to 25%.