A More Efficient Chinese Named Entity Recognition base on BERT and Syntactic Analysis
This work offers an incremental improvement in efficiency and performance for Chinese NER, which is beneficial for applications requiring faster processing of Chinese text.
The paper proposes a new method for Chinese Named Entity Recognition (NER) that integrates Part-of-speech (POS) tagging, Chinese word segmentation (CWS), and parsing results. Their g-BERT model, a compressed version of BERT, reduces calculation quantity by 60% and improves performance by 2% to a Test F1 score of 96.5 compared to the original BERT model.
We propose a new Named entity recognition (NER) method to effectively make use of the results of Part-of-speech (POS) tagging, Chinese word segmentation (CWS) and parsing while avoiding NER error caused by POS tagging error. This paper first uses Stanford natural language process (NLP) tool to annotate large-scale untagged data so as to reduce the dependence on the tagged data; then a new NLP model, g-BERT model, is designed to compress Bidirectional Encoder Representations from Transformers (BERT) model in order to reduce calculation quantity; finally, the model is evaluated based on Chinese NER dataset. The experimental results show that the calculation quantity in g-BERT model is reduced by 60% and performance improves by 2% with Test F1 to 96.5 compared with that in BERT model.