Decision Information Meets Large Language Models: The Future of Explainable Operations Research
This addresses transparency issues in OR for industries relying on automated decision-making, though it appears incremental as it builds on existing LLM integration.
The paper tackles the problem of lack of transparency and trustworthiness in Operations Research (OR) methods that use Large Language Models (LLMs) by proposing the Explainable Operations Research (EOR) framework, which introduces Decision Information from what-if analysis and uses bipartite graphs and LLMs to improve explanations, and establishes the first industrial benchmark for evaluating explanations.
Operations Research (OR) is vital for decision-making in many industries. While recent OR methods have seen significant improvements in automation and efficiency through integrating Large Language Models (LLMs), they still struggle to produce meaningful explanations. This lack of clarity raises concerns about transparency and trustworthiness in OR applications. To address these challenges, we propose a comprehensive framework, Explainable Operations Research (EOR), emphasizing actionable and understandable explanations accompanying optimization. The core of EOR is the concept of Decision Information, which emerges from what-if analysis and focuses on evaluating the impact of complex constraints (or parameters) changes on decision-making. Specifically, we utilize bipartite graphs to quantify the changes in the OR model and adopt LLMs to improve the explanation capabilities. Additionally, we introduce the first industrial benchmark to rigorously evaluate the effectiveness of explanations and analyses in OR, establishing a new standard for transparency and clarity in the field.