ROC Analysis for Evaluating Translation Quality Estimation Systems
For practitioners and businesses using automated translation quality estimation, this provides a decision-oriented evaluation method.
The paper proposes using ROC analysis for evaluating translation quality estimation systems, showing it produces results consistent with existing methods while offering actionable insights for business decisions.
The increasing use of automated translation quality estimation (QE) systems calls for practical, decision-oriented methods for evaluating their performance. We propose that Receiver Operating Characteristic (ROC) analysis is a useful approach for this purpose. Our study shows that ROC analysis not only produces results consistent with currently prevalent methods, but also offers several important advantages, including actionable performance insights that support business decision-making.