CLJun 16, 2024

Multiple Sources are Better Than One: Incorporating External Knowledge in Low-Resource Glossing

arXiv:2406.11085v125 citations
Originality Incremental advance
AI Analysis

This work addresses the challenge of limited data for glossing in low-resource languages, which is incremental as it builds on existing methods by integrating additional linguistic sources.

The paper tackled the data scarcity problem in automatic glossing for low-resource languages by incorporating multiple sources of external knowledge, resulting in an average 5%-point improvement in word-level accuracy across six languages, with up to 10%-point gains in ultra-low-resource settings.

In this paper, we address the data scarcity problem in automatic data-driven glossing for low-resource languages by coordinating multiple sources of linguistic expertise. We supplement models with translations at both the token and sentence level as well as leverage the extensive linguistic capability of modern LLMs. Our enhancements lead to an average absolute improvement of 5%-points in word-level accuracy over the previous state of the art on a typologically diverse dataset spanning six low-resource languages. The improvements are particularly noticeable for the lowest-resourced language Gitksan, where we achieve a 10%-point improvement. Furthermore, in a simulated ultra-low resource setting for the same six languages, training on fewer than 100 glossed sentences, we establish an average 10%-point improvement in word-level accuracy over the previous state-of-the-art system.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes