ELEVANT: A Fully Automatic Fine-Grained Entity Linking Evaluation and Analysis Tool
This tool addresses the need for automated, fine-grained evaluation in entity linking research, though it is incremental as it builds on existing evaluation methods.
The authors tackled the problem of evaluating entity linkers by introducing Elevant, a tool that automatically assesses performance across benchmarks, error categories, and entity types, and provides intuitive visualizations, with a live demo and code available online.
We present Elevant, a tool for the fully automatic fine-grained evaluation of a set of entity linkers on a set of benchmarks. Elevant provides an automatic breakdown of the performance by various error categories and by entity type. Elevant also provides a rich and compact, yet very intuitive and self-explanatory visualization of the results of a linker on a benchmark in comparison to the ground truth. A live demo, the link to the complete code base on GitHub and a link to a demo video are provided under https://elevant.cs.uni-freiburg.de .