COS960: A Chinese Word Similarity Dataset of 960 Word Pairs
This provides a new resource for researchers in natural language processing focusing on Chinese lexical semantics, though it is incremental as it extends existing work to a specific language and word type.
The authors tackled the lack of benchmark datasets for Chinese word similarity, particularly for words with two morphemes, by creating COS960, a dataset of 960 word pairs with human-annotated similarity scores, and tested it on various word embedding models.
Word similarity computation is a widely recognized task in the field of lexical semantics. Most proposed tasks test on similarity of word pairs of single morpheme, while few works focus on words of two morphemes or more morphemes. In this work, we propose COS960, a benchmark dataset with 960 pairs of Chinese wOrd Similarity, where all the words have two morphemes in three Part of Speech (POS) tags with their human annotated similarity rather than relatedness. We give a detailed description of dataset construction and annotation process, and test on a range of word embedding models. The dataset of this paper can be obtained from https://github.com/thunlp/COS960.