CLOct 29, 2020

Combining Self-Training and Self-Supervised Learning for Unsupervised Disfluency Detection

arXiv:2010.15360v1996 citations
Originality Incremental advance
AI Analysis

This addresses the problem of expensive human annotations for disfluency detection, offering a more accessible solution, though it is incremental as it builds on existing semi-supervised techniques.

The paper tackles unsupervised disfluency detection by combining self-training and self-supervised learning, achieving competitive performance on the English Switchboard test set compared to supervised systems like BERT and ELECTRA.

Most existing approaches to disfluency detection heavily rely on human-annotated corpora, which is expensive to obtain in practice. There have been several proposals to alleviate this issue with, for instance, self-supervised learning techniques, but they still require human-annotated corpora. In this work, we explore the unsupervised learning paradigm which can potentially work with unlabeled text corpora that are cheaper and easier to obtain. Our model builds upon the recent work on Noisy Student Training, a semi-supervised learning approach that extends the idea of self-training. Experimental results on the commonly used English Switchboard test set show that our approach achieves competitive performance compared to the previous state-of-the-art supervised systems using contextualized word embeddings (e.g. BERT and ELECTRA).

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes