CLNov 4, 2016

Morphological Inflection Generation with Hard Monotonic Attention

arXiv:1611.01487v358 citations
Originality Highly original
AI Analysis

This work addresses the problem of generating word inflections for computational linguistics, with incremental improvements in accuracy.

The authors tackled morphological inflection generation by introducing a neural model with hard monotonic attention, achieving state-of-the-art results on three datasets compared to previous approaches.

We present a neural model for morphological inflection generation which employs a hard attention mechanism, inspired by the nearly-monotonic alignment commonly found between the characters in a word and the characters in its inflection. We evaluate the model on three previously studied morphological inflection generation datasets and show that it provides state of the art results in various setups compared to previous neural and non-neural approaches. Finally we present an analysis of the continuous representations learned by both the hard and soft attention \cite{bahdanauCB14} models for the task, shedding some light on the features such models extract.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes