CLOct 21, 2022

MCSCSet: A Specialist-annotated Dataset for Medical-domain Chinese Spelling Correction

arXiv:2210.11720v117 citationsh-index: 36Has Code
Originality Synthesis-oriented
AI Analysis

This work addresses the challenge of correcting spelling errors in medical texts, which is crucial for applications like search engines and OCR systems in healthcare, but it is incremental as it focuses on dataset creation for a specific domain.

The authors tackled the problem of Chinese spelling correction in the medical domain by creating MCSCSet, a large-scale specialist-annotated dataset with about 200k samples, and showed significant performance gaps between open-domain and medical-domain correction.

Chinese Spelling Correction (CSC) is gaining increasing attention due to its promise of automatically detecting and correcting spelling errors in Chinese texts. Despite its extensive use in many applications, like search engines and optical character recognition systems, little has been explored in medical scenarios in which complex and uncommon medical entities are easily misspelled. Correcting the misspellings of medical entities is arguably more difficult than those in the open domain due to its requirements of specificdomain knowledge. In this work, we define the task of Medical-domain Chinese Spelling Correction and propose MCSCSet, a large scale specialist-annotated dataset that contains about 200k samples. In contrast to the existing open-domain CSC datasets, MCSCSet involves: i) extensive real-world medical queries collected from Tencent Yidian, ii) corresponding misspelled sentences manually annotated by medical specialists. To ensure automated dataset curation, MCSCSet further offers a medical confusion set consisting of the commonly misspelled characters of given Chinese medical terms. This enables one to create the medical misspelling dataset automatically. Extensive empirical studies have shown significant performance gaps between the open-domain and medical-domain spelling correction, highlighting the need to develop high-quality datasets that allow for Chinese spelling correction in specific domains. Moreover, our work benchmarks several representative Chinese spelling correction models, establishing baselines for future work.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes