RubikSQL: Lifelong Learning Agentic Knowledge Base as an Industrial NL2SQL System
This work solves the problem of generating accurate SQL queries from natural language in industrial settings for enterprise users, representing an incremental improvement with domain-specific focus.
The paper tackles the problem of real-world enterprise-level NL2SQL by developing RubikSQL, a system that addresses challenges like implicit intents and domain-specific terminology through lifelong learning and a multi-agent workflow, achieving state-of-the-art performance on KaggleDBQA and BIRD Mini-Dev datasets.
We present RubikSQL, a novel NL2SQL system designed to address key challenges in real-world enterprise-level NL2SQL, such as implicit intents and domain-specific terminology. RubikSQL frames NL2SQL as a lifelong learning task, demanding both Knowledge Base (KB) maintenance and SQL generation. RubikSQL systematically builds and refines its KB through techniques including database profiling, structured information extraction, agentic rule mining, and Chain-of-Thought (CoT)-enhanced SQL profiling. RubikSQL then employs a multi-agent workflow to leverage this curated KB, generating accurate SQLs. RubikSQL achieves SOTA performance on both the KaggleDBQA and BIRD Mini-Dev datasets. Finally, we release the RubikBench benchmark, a new benchmark specifically designed to capture vital traits of industrial NL2SQL scenarios, providing a valuable resource for future research.