MATA: Multi-Agent Framework for Reliable and Flexible Table Question Answering
This addresses TableQA challenges for resource-constrained or privacy-sensitive environments, offering an incremental improvement through orchestration of existing methods.
The paper tackles the problem of ensuring reliability, scalability, and efficiency in Table Question Answering (TableQA) by introducing MATA, a multi-agent framework that uses multiple reasoning paths and tools with small language models, achieving state-of-the-art accuracy and high efficiency in experiments across benchmarks and LLMs.
Recent advances in Large Language Models (LLMs) have significantly improved table understanding tasks such as Table Question Answering (TableQA), yet challenges remain in ensuring reliability, scalability, and efficiency, especially in resource-constrained or privacy-sensitive environments. In this paper, we introduce MATA, a multi-agent TableQA framework that leverages multiple complementary reasoning paths and a set of tools built with small language models. MATA generates candidate answers through diverse reasoning styles for a given table and question, then refines or selects the optimal answer with the help of these tools. Furthermore, it incorporates an algorithm designed to minimize expensive LLM agent calls, enhancing overall efficiency. MATA maintains strong performance with small, open-source models and adapts easily across various LLM types. Extensive experiments on two benchmarks of varying difficulty with ten different LLMs demonstrate that MATA achieves state-of-the-art accuracy and highly efficient reasoning while avoiding excessive LLM inference. Our results highlight that careful orchestration of multiple reasoning pathways yields scalable and reliable TableQA. The code is available at https://github.com/AIDAS-Lab/MATA.