System Combination for Grammatical Error Correction Based on Integer Programming
This work addresses grammatical error correction for language learners or writers by improving accuracy through system combination, but it is incremental as it builds on existing methods.
The paper tackles the problem of grammatical error correction by proposing a system combination method based on integer programming, which optimizes selection of the best system for each error type, resulting in a 3.61% improvement in F0.5 score and achieving 73.08% when combining top systems.
In this paper, we propose a system combination method for grammatical error correction (GEC), based on nonlinear integer programming (IP). Our method optimizes a novel F score objective based on error types, and combines multiple end-to-end GEC systems. The proposed IP approach optimizes the selection of a single best system for each grammatical error type present in the data. Experiments of the IP approach on combining state-of-the-art standalone GEC systems show that the combined system outperforms all standalone systems. It improves F0.5 score by 3.61% when combining the two best participating systems in the BEA 2019 shared task, and achieves F0.5 score of 73.08%. We also perform experiments to compare our IP approach with another state-of-the-art system combination method for GEC, demonstrating IP's competitive combination capability.