CLLGSep 9, 2021

Fixing exposure bias with imitation learning needs powerful oracles

arXiv:2109.04114v23 citations
AI Analysis

This addresses exposure bias in neural machine translation for NLP researchers, but appears incremental as it evaluates a specific oracle limitation.

The paper tackled the neural machine translation exposure bias problem using imitation learning with error-correcting oracles, finding that an SMT lattice-based oracle performed well in translation tasks but was too pruned and idiosyncratic to effectively serve as the oracle for imitation learning.

We apply imitation learning (IL) to tackle the NMT exposure bias problem with error-correcting oracles, and evaluate an SMT lattice-based oracle which, despite its excellent performance in an unconstrained oracle translation task, turned out to be too pruned and idiosyncratic to serve as the oracle for IL.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes