DISC: Plug-and-Play Decoding Intervention with Similarity of Characters for Chinese Spelling Check
This addresses the problem of error detection in Chinese text for users and applications, but it is incremental as it builds on existing models without training costs.
The paper tackles the Chinese spelling check task by proposing a plug-and-play module that uses phonetic and glyph similarities between characters during inference, significantly improving performance on benchmarks and approaching or surpassing state-of-the-art models.
One key characteristic of the Chinese spelling check (CSC) task is that incorrect characters are usually similar to the correct ones in either phonetics or glyph. To accommodate this, previous works usually leverage confusion sets, which suffer from two problems, i.e., difficulty in determining which character pairs to include and lack of probabilities to distinguish items in the set. In this paper, we propose a light-weight plug-and-play DISC (i.e., decoding intervention with similarity of characters) module for CSC models.DISC measures phonetic and glyph similarities between characters and incorporates this similarity information only during the inference phase. This method can be easily integrated into various existing CSC models, such as ReaLiSe, SCOPE, and ReLM, without additional training costs. Experiments on three CSC benchmarks demonstrate that our proposed method significantly improves model performance, approaching and even surpassing the current state-of-the-art models.