Graph Repairs with Large Language Models: An Empirical Study
This addresses the challenge of scalable graph repair for domains like healthcare and finance, though it appears incremental as it evaluates existing LLMs rather than proposing a new method.
The paper tackles the problem of repairing errors in property graphs by evaluating six open-source Large Language Models (LLMs) for automated detection and correction. The results show that LLMs have varying degrees of accuracy and efficiency in graph repair tasks.
Property graphs are widely used in domains such as healthcare, finance, and social networks, but they often contain errors due to inconsistencies, missing data, or schema violations. Traditional rule-based and heuristic-driven graph repair methods are limited in their adaptability as they need to be tailored for each dataset. On the other hand, interactive human-in-the-loop approaches may become infeasible when dealing with large graphs, as the cost--both in terms of time and effort--of involving users becomes too high. Recent advancements in Large Language Models (LLMs) present new opportunities for automated graph repair by leveraging contextual reasoning and their access to real-world knowledge. We evaluate the effectiveness of six open-source LLMs in repairing property graphs. We assess repair quality, computational cost, and model-specific performance. Our experiments show that LLMs have the potential to detect and correct errors, with varying degrees of accuracy and efficiency. We discuss the strengths, limitations, and challenges of LLM-driven graph repair and outline future research directions for improving scalability and interpretability.