The Impact of Automatic Speech Transcription on Speaker Attribution
This addresses the problem of speaker attribution in real-world settings where only errorful ASR transcripts are available, offering an incremental improvement by showing robustness to transcription errors.
The study investigated how automatic speech recognition (ASR) transcription errors affect speaker attribution from speech transcripts, finding that attribution is resilient to word-level errors and can perform as well or better than using human-transcribed data, with ASR errors potentially capturing speaker-specific features.
Speaker attribution from speech transcripts is the task of identifying a speaker from the transcript of their speech based on patterns in their language use. This task is especially useful when the audio is unavailable (e.g. deleted) or unreliable (e.g. anonymized speech). Prior work in this area has primarily focused on the feasibility of attributing speakers using transcripts produced by human annotators. However, in real-world settings, one often only has more errorful transcripts produced by automatic speech recognition (ASR) systems. In this paper, we conduct what is, to our knowledge, the first comprehensive study of the impact of automatic transcription on speaker attribution performance. In particular, we study the extent to which speaker attribution performance degrades in the face of transcription errors, as well as how properties of the ASR system impact attribution. We find that attribution is surprisingly resilient to word-level transcription errors and that the objective of recovering the true transcript is minimally correlated with attribution performance. Overall, our findings suggest that speaker attribution on more errorful transcripts produced by ASR is as good, if not better, than attribution based on human-transcribed data, possibly because ASR transcription errors can capture speaker-specific features revealing of speaker identity.