An LLM Agent-Based Complex Semantic Table Annotation Approach
This work provides an efficient solution for semantic table annotation, which is important for various semantic applications, but it is incremental as it builds on existing LLM and ReAct frameworks.
The paper tackles the problem of annotating complex tables with semantic information, addressing challenges like semantic loss and homonyms, and achieves a 70% reduction in time costs and a 60% reduction in LLM token usage while outperforming existing methods.
The Semantic Table Annotation (STA) task, which includes Column Type Annotation (CTA) and Cell Entity Annotation (CEA), maps table contents to ontology entities and plays important roles in various semantic applications. However, complex tables often pose challenges such as semantic loss of column names or cell values, strict ontological hierarchy requirements, homonyms, spelling errors, and abbreviations, which hinder annotation accuracy. To address these issues, this paper proposes an LLM-based agent approach for CTA and CEA. We design and implement five external tools with tailored prompts based on the ReAct framework, enabling the STA agent to dynamically select suitable annotation strategies depending on table characteristics. Experiments are conducted on the Tough Tables and BiodivTab datasets from the SemTab challenge, which contain the aforementioned challenges. Our method outperforms existing approaches across various metrics. Furthermore, by leveraging Levenshtein distance to reduce redundant annotations, we achieve a 70% reduction in time costs and a 60% reduction in LLM token usage, providing an efficient and cost-effective solution for STA.