CLLGSep 6, 2024

Medical Concept Normalization in a Low-Resource Setting

arXiv:2409.14579v1h-index: 1
Originality Synthesis-oriented
AI Analysis

This addresses a domain-specific problem for biomedical NLP in low-resource settings, but it is incremental as it applies existing methods to a new dataset.

The paper tackled medical concept normalization in low-resource German lay texts by creating a new dataset from a medical forum and found that multilingual Transformer models outperformed string similarity methods, though contextual information did not improve results.

In the field of biomedical natural language processing, medical concept normalization is a crucial task for accurately mapping mentions of concepts to a large knowledge base. However, this task becomes even more challenging in low-resource settings, where limited data and resources are available. In this thesis, I explore the challenges of medical concept normalization in a low-resource setting. Specifically, I investigate the shortcomings of current medical concept normalization methods applied to German lay texts. Since there is no suitable dataset available, a dataset consisting of posts from a German medical online forum is annotated with concepts from the Unified Medical Language System. The experiments demonstrate that multilingual Transformer-based models are able to outperform string similarity methods. The use of contextual information to improve the normalization of lay mentions is also examined, but led to inferior results. Based on the results of the best performing model, I present a systematic error analysis and lay out potential improvements to mitigate frequent errors.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes