CLJul 21, 2024

Fine-grained Gender Control in Machine Translation with Large Language Models

arXiv:2407.15154v131 citationsh-index: 5
Originality Incremental advance
AI Analysis

This addresses gender bias in machine translation for users needing accurate gender inflection, though it builds incrementally on existing controlled translation work.

The paper tackles the problem of ambiguous gender in machine translation by proposing a method for fine-grained gender control of multiple entities, achieving state-of-the-art performance on four benchmarks.

In machine translation, the problem of ambiguously gendered input has been pointed out, where the gender of an entity is not available in the source sentence. To address this ambiguity issue, the task of controlled translation that takes the gender of the ambiguous entity as additional input have been proposed. However, most existing works have only considered a simplified setup of one target gender for input. In this paper, we tackle controlled translation in a more realistic setting of inputs with multiple entities and propose Gender-of-Entity (GoE) prompting method for LLMs. Our proposed method instructs the model with fine-grained entity-level gender information to translate with correct gender inflections. By utilizing four evaluation benchmarks, we investigate the controlled translation capability of LLMs in multiple dimensions and find that LLMs reach state-of-the-art performance in controlled translation. Furthermore, we discover an emergence of gender interference phenomenon when controlling the gender of multiple entities. Finally, we address the limitations of existing gender accuracy evaluation metrics and propose leveraging LLMs as an evaluator for gender inflection in machine translation.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes