CLNov 11, 2020

Morphological Disambiguation from Stemming Data

arXiv:2011.05504v1990 citations
AI Analysis

This work addresses a crucial preprocessing step for natural language processing in Kinyarwanda, providing a tool for a language with no existing automated morphological analysis, though it is incremental as it applies existing methods to new data.

The paper tackles the problem of morphological disambiguation for Kinyarwanda, a morphologically rich language lacking automated tools, by learning from a new crowd-sourced stemming dataset and achieves about 89% non-contextualized disambiguation accuracy using feature engineering and a feed-forward neural network classifier.

Morphological analysis and disambiguation is an important task and a crucial preprocessing step in natural language processing of morphologically rich languages. Kinyarwanda, a morphologically rich language, currently lacks tools for automated morphological analysis. While linguistically curated finite state tools can be easily developed for morphological analysis, the morphological richness of the language allows many ambiguous analyses to be produced, requiring effective disambiguation. In this paper, we propose learning to morphologically disambiguate Kinyarwanda verbal forms from a new stemming dataset collected through crowd-sourcing. Using feature engineering and a feed-forward neural network based classifier, we achieve about 89% non-contextualized disambiguation accuracy. Our experiments reveal that inflectional properties of stems and morpheme association rules are the most discriminative features for disambiguation.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes