LGCVOct 6, 2020

Denoising Diffusion Implicit Models

arXiv:2010.02502v412228 citations
Originality Incremental advance
AI Analysis

This accelerates image generation for AI applications, though it is an incremental improvement over DDPMs.

The paper tackles the slow sampling speed of denoising diffusion probabilistic models (DDPMs) by introducing denoising diffusion implicit models (DDIMs), which achieve high-quality image generation 10 to 50 times faster in wall-clock time.

Denoising diffusion probabilistic models (DDPMs) have achieved high quality image generation without adversarial training, yet they require simulating a Markov chain for many steps to produce a sample. To accelerate sampling, we present denoising diffusion implicit models (DDIMs), a more efficient class of iterative implicit probabilistic models with the same training procedure as DDPMs. In DDPMs, the generative process is defined as the reverse of a Markovian diffusion process. We construct a class of non-Markovian diffusion processes that lead to the same training objective, but whose reverse process can be much faster to sample from. We empirically demonstrate that DDIMs can produce high quality samples $10 \times$ to $50 \times$ faster in terms of wall-clock time compared to DDPMs, allow us to trade off computation for sample quality, and can perform semantically meaningful image interpolation directly in the latent space.

Code Implementations29 repos

Data from Papers with Code (CC-BY-SA-4.0)

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes