Evaluating Ontology Matching Systems on Large, Multilingual and Real-world Test Cases
This work provides systematic evaluation for researchers and practitioners in ontology matching, but it is incremental as it builds on prior OAEI campaigns.
The paper reports results from the OAEI 2011.5 campaign, evaluating 18 ontology matching systems across five tracks, including new or improved ones, to assess scalability, multilingual capabilities, and real-world domain handling.
In the field of ontology matching, the most systematic evaluation of matching systems is established by the Ontology Alignment Evaluation Initiative (OAEI), which is an annual campaign for evaluating ontology matching systems organized by different groups of researchers. In this paper, we report on the results of an intermediary OAEI campaign called OAEI 2011.5. The evaluations of this campaign are divided in five tracks. Three of these tracks are new or have been improved compared to previous OAEI campaigns. Overall, we evaluated 18 matching systems. We discuss lessons learned, in terms of scalability, multilingual issues and the ability do deal with real world cases from different domains.