Assessing Post-editing Effort in the English-Hindi Direction
This addresses the efficiency of machine translation post-editing for professional translators in a specific language pair, but it is incremental as it applies known methods to a new direction.
The study tackled the problem of estimating post-editing effort for English-Hindi translation by comparing it to translation from scratch, finding that post-editing reduces translation time by 63%, keystrokes by 59%, and pauses by 63% without quality differences.
We present findings from a first in-depth post-editing effort estimation study in the English-Hindi direction along multiple effort indicators. We conduct a controlled experiment involving professional translators, who complete assigned tasks alternately, in a translation from scratch and a post-edit condition. We find that post-editing reduces translation time (by 63%), utilizes fewer keystrokes (by 59%), and decreases the number of pauses (by 63%) when compared to translating from scratch. We further verify the quality of translations thus produced via a human evaluation task in which we do not detect any discernible quality differences.