CLJan 17, 2021

Few Shot Dialogue State Tracking using Meta-learning

arXiv:2101.06779v3808 citations
Originality Incremental advance
AI Analysis

This addresses the need for deploying automated chatbot systems in new domains with minimal data, though it appears incremental as it builds on existing meta-learning methods.

The paper tackles the problem of few-shot dialogue state tracking (DST) for chatbots in new domains by proposing a meta-learner called D-REPTILE, which shows significant improvements of 5-25% over baselines in low-data settings.

Dialogue State Tracking (DST) forms a core component of automated chatbot based systems designed for specific goals like hotel, taxi reservation, tourist information, etc. With the increasing need to deploy such systems in new domains, solving the problem of zero/few-shot DST has become necessary. There has been a rising trend for learning to transfer knowledge from resource-rich domains to unknown domains with minimal need for additional data. In this work, we explore the merits of meta-learning algorithms for this transfer and hence, propose a meta-learner D-REPTILE specific to the DST problem. With extensive experimentation, we provide clear evidence of benefits over conventional approaches across different domains, methods, base models, and datasets with significant (5-25%) improvement over the baseline in a low-data setting. Our proposed meta-learner is agnostic of the underlying model and hence any existing state-of-the-art DST system can improve its performance on unknown domains using our training strategy.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes