Learning Branching Policies for MILPs with Proximal Policy Optimization
This addresses the challenge of exponential time complexity in MILP solvers for optimization practitioners, offering a robust and adaptable approach, though it is incremental as it builds on prior learning-based methods.
The paper tackled the problem of improving Branch-and-Bound for Mixed Integer Linear Programs by learning branching policies, proposing Tree-Gate Proximal Policy Optimization to enhance generalization, and showed it often outperforms existing methods in reducing nodes explored and improving p-Primal-Dual Integrals, especially on out-of-distribution instances.
Branch-and-Bound (B\&B) is the dominant exact solution method for Mixed Integer Linear Programs (MILP), yet its exponential time complexity poses significant challenges for large-scale instances. The growing capabilities of machine learning have spurred efforts to improve B\&B by learning data-driven branching policies. However, most existing approaches rely on Imitation Learning (IL), which tends to overfit to expert demonstrations and struggles to generalize to structurally diverse or unseen instances. In this work, we propose Tree-Gate Proximal Policy Optimization (TGPPO), a novel framework that employs Proximal Policy Optimization (PPO), a Reinforcement Learning (RL) algorithm, to train a branching policy aimed at improving generalization across heterogeneous MILP instances. Our approach builds on a parameterized state space representation that dynamically captures the evolving context of the search tree. Empirical evaluations show that TGPPO often outperforms existing learning-based policies in terms of reducing the number of nodes explored and improving p-Primal-Dual Integrals (PDI), particularly in out-of-distribution instances. These results highlight the potential of RL to develop robust and adaptable branching strategies for MILP solvers.