A Corpus-based Evaluation of Lexical Components of a Domainspecific Text to Knowledge Mapping Prototype
This addresses the need for domain-specific NLP evaluation in physics education, but it is incremental as it focuses on lexical enrichment without major methodological breakthroughs.
The paper evaluates the lexical components of a domain-specific Text to Knowledge Mapping prototype for physics (DC electrical circuits) by developing and annotating a new corpus, resulting in the prototype parsing a reasonable amount of sentences.
The aim of this paper is to evaluate the lexical components of a Text to Knowledge Mapping (TKM) prototype. The prototype is domain-specific, the purpose of which is to map instructional text onto a knowledge domain. The context of the knowledge domain of the prototype is physics, specifically DC electrical circuits. During development, the prototype has been tested with a limited data set from the domain. The prototype now reached a stage where it needs to be evaluated with a representative linguistic data set called corpus. A corpus is a collection of text drawn from typical sources which can be used as a test data set to evaluate NLP systems. As there is no available corpus for the domain, we developed a representative corpus and annotated it with linguistic information. The evaluation of the prototype considers one of its two main components- lexical knowledge base. With the corpus, the evaluation enriches the lexical knowledge resources like vocabulary and grammar structure. This leads the prototype to parse a reasonable amount of sentences in the corpus.