CVMay 18

GeoFlow: Enforcing Implicit Geometric Consistency in Video Generation

arXiv:2605.1836596.4
Predicted impact top 7% in CV · last 90 daysOriginality Incremental advance
AI Analysis

For text-to-video generation, this work addresses the persistent problem of geometric inconsistencies (deformation, texture drift) by providing a model-agnostic fine-tuning method that improves consistency without sacrificing quality.

GeoFlow introduces a geometry-consistency reward that separates rigid and dynamic motion in generated videos, using reinforcement fine-tuning to explicitly optimize geometric consistency. It reduces temporal geometric artifacts substantially over strong baselines while preserving perceptual quality.

Generating geometrically consistent videos remains an open challenge: text-to-video diffusion models trained on web-scale data treat geometry only implicitly, leading to object deformation, texture drift, and non-rigid backgrounds under camera motion. Existing solutions either improve consistency as a byproduct, apply only to static scenes or realign the latent space of the model completely. We introduce a geometry-consistency reward that directly measures whether motion in a generated video is compatible with a coherent scene. Our key insight is that in physically consistent videos, background motion should be explainable by rigid camera-induced flow, while independently moving objects should preserve appearance identity along motion trajectories. We operationalize this using optical flow, depth--pose predictions, and feature-based correspondence to separate rigid and dynamic regions and evaluate their respective consistency. Integrating this reward with reinforcement fine-tuning transforms geometric consistency from an emergent property into an explicit optimization objective for video generators. The approach is model agnostic and applies to diverse dynamic scenes containing both camera and object motion. Experiments show substantial reductions in temporal geometric artifacts over strong baselines while preserving perceptual quality. Code and model weights are published.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes