TeDiO: Temporal Diagonal Optimization for Training-Free Coherent Video Diffusion
For practitioners using video diffusion models, TeDiO offers a training-free, plug-and-play method to improve temporal coherence while preserving per-frame quality.
TeDiO addresses temporal incoherence in text-to-video diffusion transformers by regularizing intermediate self-attention maps to promote smooth temporal diagonals, achieving markedly smoother motion without modifying model weights or using external supervision.
Recent text-to-video diffusion transformers generate visually compelling frames, yet still struggle with temporal coherence, often producing flickering, drifting, or unstable motion. We show that these failures leave a clear imprint inside the model: incoherent videos consistently exhibit irregular, fragmented temporal diagonals in their intermediate self-attention maps, whereas stable motion corresponds to smooth, band-diagonal patterns. Building on this observation, we introduce TeDiO, a training-free, inference-time method that reinforces temporal consistency by regularizing these internal attention patterns. TeDiO estimates diagonal smoothness, identifies unstable regions, and performs lightweight latent updates that promote coherent frame-to-frame dynamics, without modifying model weights or using external motion supervision. Across multiple video diffusion models (e.g., Wan2.1, CogVideoX), TeDiO delivers markedly smoother motion while preserving per-frame visual quality, offering an efficient plug-and-play approach to improving dynamic realism in modern video generation systems.