ExtracTable: Human-in-the-Loop Transformation of Scientific Corpora into Structured Knowledge
For researchers conducting literature reviews, ExtracTable significantly accelerates the process of structuring scientific content into knowledge graphs, though it requires human validation.
ExtracTable is a human-in-the-loop workflow that combines LLMs with user-defined schemas to transform unstructured scientific publications into structured knowledge for knowledge graphs. In an evaluation with ORKG community participants, it achieved an average SUS score of 84.17 and reduced the time to extract literature-based insights from 4 hours–2 weeks to an average of 24:40 minutes.
As the volume of scientific literature grows, efficient knowledge organization becomes increasingly challenging. Traditional approaches to structuring scientific content are time-consuming and require significant domain expertise, highlighting the need for tool support. We present ExtracTable, a Human-in-the-Loop (HITL) workflow and framework that assists researchers in transforming unstructured publications into structured representations. The workflow combines large language models (LLMs) with user-defined schemas and is designed for downstream integration into knowledge graphs (KGs). Developed and evaluated in the context of the Open Research Knowledge Graph (ORKG), ExtracTable automates key steps such as document preprocessing and data extraction while ensuring user oversight through validation. In an evaluation with ORKG community participants following the Quality Improvement Paradigm (QIP), ExtracTable demonstrated high usability and practical value. Participants gave it an average System Usability Scale (SUS) score of 84.17 (A+, the highest rating). The time to progress from a research interest to literature-based insights was reduced from between 4 hours and 2 weeks to an average of 24:40 minutes. By streamlining corpus creation and structured data extraction for knowledge graph integration, ExtracTable leverages LLMs and user models to accelerate literature reviews. However, human validation remains essential to ensure quality, and future work will address improving extraction accuracy and entity linking to existing knowledge resources.