ConExion: Concept Extraction with Large Language Models
This work addresses the problem of comprehensive concept extraction for ontology evaluation and learning, though it appears incremental as it builds on existing LLM techniques.
The paper tackles concept extraction from documents using large language models, focusing on extracting all domain-related concepts rather than just keyphrases, and demonstrates improved F1 scores on benchmark datasets compared to state-of-the-art methods.
In this paper, an approach for concept extraction from documents using pre-trained large language models (LLMs) is presented. Compared with conventional methods that extract keyphrases summarizing the important information discussed in a document, our approach tackles a more challenging task of extracting all present concepts related to the specific domain, not just the important ones. Through comprehensive evaluations of two widely used benchmark datasets, we demonstrate that our method improves the F1 score compared to state-of-the-art techniques. Additionally, we explore the potential of using prompts within these models for unsupervised concept extraction. The extracted concepts are intended to support domain coverage evaluation of ontologies and facilitate ontology learning, highlighting the effectiveness of LLMs in concept extraction tasks. Our source code and datasets are publicly available at https://github.com/ISE-FIZKarlsruhe/concept_extraction.