LGMay 7

Diffusion-Based Posterior Sampling: A Feynman-Kac Analysis of Bias and Stability

arXiv:2605.0653877.2
Predicted impact top 23% in LG · last 90 daysOriginality Incremental advance
AI Analysis

For researchers using diffusion models for inverse problems, this work offers a theoretical understanding of sampler bias and stability, explaining existing heuristics and guiding the design of more reliable variants.

The paper provides a theoretical analysis of bias and stability in diffusion-based posterior samplers, deriving a Feynman-Kac representation that quantifies sampling bias and explaining instabilities in low-temperature regimes. It applies this framework to DPS and STSL samplers, showing how bias arises and how early guidance-stopping mitigates instability.

Diffusion-based posterior samplers use pretrained diffusion priors to sample from measurement- or reward-conditioned posteriors, and are widely used for inverse problems. Yet their theoretical behavior remains poorly understood: even with exact prior scores, their outputs are biased, and in low-temperature regimes their discretizations can become unstable. We characterize this bias by introducing a tractable surrogate path connecting the true posterior to a standard Gaussian and comparing it to the sampler's path. Their density ratio satisfies a parabolic PDE whose reaction term measures the accumulated bias. A Feynman-Kac representation then expresses the Radon-Nikodym correction as an explicit path expectation, identifying which posterior regions are over- or under-sampled. We apply this framework to DPS and STSL, a related sampler. For DPS, the correction is an Ornstein-Uhlenbeck path expectation coupling the data conditional covariance with the reward curvature, revealing where DPS over- or under-samples. Next, we reinterpret STSL as an auxiliary drift that steers trajectories toward low-uncertainty regions, flattening the spatially varying part of the DPS reaction term. Finally, we characterize early guidance-stopping, a common mitigation for low-temperature instabilities caused by forward-Euler integration of the vector field. Together, these results clarify sampler bias, explain existing correctives, and guide stable variant designs.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes