Adaptive Diffusion Guidance via Stochastic Optimal Control
This work addresses a key theoretical gap in diffusion models for researchers and practitioners, offering a non-incremental improvement in guidance scheduling.
The paper tackled the heuristic nature of guidance scheduling in diffusion models by providing a theoretical formalization linking guidance strength to classifier confidence and introducing a stochastic optimal control framework for adaptive optimization, resulting in a principled foundation for more effective guidance.
Guidance is a cornerstone of modern diffusion models, playing a pivotal role in conditional generation and enhancing the quality of unconditional samples. However, current approaches to guidance scheduling--determining the appropriate guidance weight--are largely heuristic and lack a solid theoretical foundation. This work addresses these limitations on two fronts. First, we provide a theoretical formalization that precisely characterizes the relationship between guidance strength and classifier confidence. Second, building on this insight, we introduce a stochastic optimal control framework that casts guidance scheduling as an adaptive optimization problem. In this formulation, guidance strength is not fixed but dynamically selected based on time, the current sample, and the conditioning class, either independently or in combination. By solving the resulting control problem, we establish a principled foundation for more effective guidance in diffusion models.