Learning to Reduce: Towards Improving Performance of Large Language Models on Structured Data
This addresses the problem of inefficient inference on structured data for LLM users, but it is incremental as it builds on existing fine-tuning and reduction techniques.
The paper tackles the challenge of LLMs performing inference on structured data by proposing Learning to Reduce, a framework that fine-tunes a model to generate reduced versions of input data, resulting in improved performance on table QA tasks, especially with longer contexts.
Large Language Models (LLMs) have been achieving competent performance on a wide range of downstream tasks, yet existing work shows that inference on structured data is challenging for LLMs. This is because LLMs need to either understand long structured data or select the most relevant evidence before inference, and both approaches are not trivial. This paper proposes a framework, Learning to Reduce, that fine-tunes a language model with On-Policy Learning to generate a reduced version of an input structured data. When compared to state-of-the-art LLMs like GPT-4, Learning to Reduce not only achieves outstanding performance in reducing the input, but shows generalizability on different datasets. We further show that the model fine-tuned with our framework helps LLMs better perform on table QA tasks especially when the context is longer.