Low Resource Pipeline for Spoken Language Understanding via Weak Supervision
This work addresses the challenge of data scarcity in SLU for applications like sentiment and emotion classification, offering a flexible and generalizable approach, though it is incremental in improving weak supervision techniques.
The paper tackles the problem of training models for Spoken Language Understanding (SLU) tasks with limited labeled data by using prompt-based methods as weak supervision sources, achieving over 4% improvement in Macro-F1 on zero and few-shot benchmarks compared to other low-resource methods.
In Weak Supervised Learning (WSL), a model is trained over noisy labels obtained from semantic rules and task-specific pre-trained models. Rules offer limited generalization over tasks and require significant manual efforts while pre-trained models are available only for limited tasks. In this work, we propose to utilize prompt-based methods as weak sources to obtain the noisy labels on unannotated data. We show that task-agnostic prompts are generalizable and can be used to obtain noisy labels for different Spoken Language Understanding (SLU) tasks such as sentiment classification, disfluency detection and emotion classification. These prompts could additionally be updated to add task-specific contexts, thus providing flexibility to design task-specific prompts. We demonstrate that prompt-based methods generate reliable labels for the above SLU tasks and thus can be used as a universal weak source to train a weak-supervised model (WSM) in absence of labeled data. Our proposed WSL pipeline trained over prompt-based weak source outperforms other competitive low-resource benchmarks on zero and few-shot learning by more than 4% on Macro-F1 on all of the three benchmark SLU datasets. The proposed method also outperforms a conventional rule based WSL pipeline by more than 5% on Macro-F1.