Assessing Semantic Annotation Activities with Formal Concept Analysis
This addresses the need for better tools to evaluate and improve semantic annotation processes in collaborative digital text annotation, though it appears incremental.
The paper tackles the problem of assessing semantic annotation activities by using formal concept analysis to provide domain experts with concept lattices that visualize how ontologies are used, enabling them to advise annotators and refine ontologies, with implementation and evaluation demonstrated in a case study.
This paper describes an approach to assessing semantic annotation activities based on formal concept analysis (FCA). In this approach, annotators use taxonomical ontologies created by domain experts to annotate digital resources. Then, using FCA, domain experts are provided with concept lattices that graphically display how their ontologies were used during the semantic annotation process. In consequence, they can advise annotators on how to better use the ontologies, as well as how to refine them to better suit the needs of the semantic annotators. To illustrate the approach, we describe its implementation in @note, a Rich Internet Application (RIA) for the collaborative annotation of digitized literary texts, we exemplify its use with a case study, and we provide some evaluation results using the method.