CLAug 5, 2023

LaDA: Latent Dialogue Action For Zero-shot Cross-lingual Neural Network Language Modeling

arXiv:2308.02903v11 citationsh-index: 6
Originality Incremental advance
AI Analysis

This addresses the challenge of intent detection and slot filling in multilingual conversational AI systems, particularly for languages differing significantly from the source, representing an incremental improvement with a novel method.

The paper tackles the problem of cross-lingual spoken language understanding for distant languages with limited resources, proposing a Latent Dialogue Action layer that achieves state-of-the-art results on public datasets for zero-shot and few-shot adaptation.

Cross-lingual adaptation has proven effective in spoken language understanding (SLU) systems with limited resources. Existing methods are frequently unsatisfactory for intent detection and slot filling, particularly for distant languages that differ significantly from the source language in scripts, morphology, and syntax. Latent Dialogue Action (LaDA) layer is proposed to optimize decoding strategy in order to address the aforementioned issues. The model consists of an additional layer of latent dialogue action. It enables our model to improve a system's capability of handling conversations with complex multilingual intent and slot values of distant languages. To the best of our knowledge, this is the first exhaustive investigation of the use of latent variables for optimizing cross-lingual SLU policy during the decode stage. LaDA obtains state-of-the-art results on public datasets for both zero-shot and few-shot adaptation.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes