Classifying the reported ability in clinical mobility descriptions
This work addresses the problem of modeling health states from clinical text for healthcare professionals, but it is incremental as it establishes a baseline for a new task.
The paper tackled the novel task of classifying four types of assertions about activity performance in clinical free text, achieving a 77.9% macro F1 score and nearly 80% recall on rare classes.
Assessing how individuals perform different activities is key information for modeling health states of individuals and populations. Descriptions of activity performance in clinical free text are complex, including syntactic negation and similarities to textual entailment tasks. We explore a variety of methods for the novel task of classifying four types of assertions about activity performance: Able, Unable, Unclear, and None (no information). We find that ensembling an SVM trained with lexical features and a CNN achieves 77.9% macro F1 score on our task, and yields nearly 80% recall on the rare Unclear and Unable samples. Finally, we highlight several challenges in classifying performance assertions, including capturing information about sources of assistance, incorporating syntactic structure and negation scope, and handling new modalities at test time. Our findings establish a strong baseline for this novel task, and identify intriguing areas for further research.