Mutation-Guided Differentiable Quadratic Combinatorial Optimization
For combinatorial optimization practitioners, this work addresses the stalling bottleneck in gradient-based solvers, enabling better performance without heavy GPU parallelization.
The paper identifies that gradient-based methods for QUBO problems stall at local maxima, and proposes a mutation-based global reset algorithm (mQO) that dramatically improves performance, achieving superior results on large-scale graphs against state-of-the-art heuristics and solvers.
Recent studies suggest that gradient-based methods applied to relaxed box-constrained Quadratic Unconstrained Binary Optimization (QUBO) formulations can outperform classical heuristics in some large-scale regimes, often relying on heavy parallelization. However, these methods still underperform heuristics in other settings. In this work, we clarify this apparent discrepancy through a detailed analysis of the relaxed non-convex QUBO local maxima for both the Maximum Independent Set (MIS) and Maximum Cut (MaxCut) problems, and by introducing a new quadratic objective for MaxCut. Motivated by this analysis, we propose a mutation-based differentiable global reset algorithm, combined with local search to escape local maxima. We term our approach mQO, standing for mutation-based Quadratic combinatorial Optimization. The proposed strategy dramatically improves the performance of gradient-based solvers without heavy reliance on GPU parallelized initializations, indicating that stalling, rather than model capacity or compute, is the dominant bottleneck. As a result, on large-scale graphs, mQO achieves superior performance against state-of-the-art heuristics, commercial integer programming solvers, and recent GPU methods.