Improved Hardness Results for Min-Max Optimization with Coupled Constraints
For complexity theorists, this paper strengthens hardness results for min-max optimization, showing that even simple objectives become intractable under coupled or general constraints.
The authors prove that min-max optimization under coupled constraints is PPAD-hard even for quadratic-linear objectives, and show that with general constraints, convex-concave (bilinear) problems become PPAD-hard. They also provide PPAD-membership for a related problem.
We investigate the computational complexity of min-max optimization under coupled constraints. The work of Daskalakis, Skoulakis, and Zampetakis [DSZ21] was the first to study min-max optimization through the lens of computational complexity, showing that min-max problems with nonconvex-nonconcave objectives are PPAD-hard under coupled constraints. By carefully exploiting the coupled constraints rather than the structure of the objective function, we are able to significantly simplify and strengthen the proof of the hardness result. More precisely, the first contribution of this paper is a fundamentally new proof of their main result, which improves it in multiple directions: it holds for degree-$2$ polynomials which are quadratic-linear, it improves the dependence on the parameters of the problem (also yielding constant inapproximability for gradient descent-ascent in $\ell_\infty$-norm), and it is much simpler than previous approaches. Second, we show that with general constraints (i.e., the min player and max player have different constraints), even convex-concave (bilinear) min-max optimization becomes PPAD-hard. Along the way, we also provide PPAD-membership of a general problem related to quasi-variational inequalities, which has applications beyond our problem.