FiffDepth: Feed-forward Transformation of Diffusion-Based Generators for Detailed Depth Estimation
This addresses the problem of limited real-world labeled data and distribution gaps in MDE for applications like 3D scene reconstruction and autonomous navigation, representing a novel method for a known bottleneck.
The paper tackles the challenge of robust and generalizable Monocular Depth Estimation (MDE) by proposing FiffDepth, which transforms diffusion-based image generators into a feed-forward architecture for detailed depth estimation, achieving exceptional accuracy, stability, and fine-grained detail with significant improvements over state-of-the-art methods.
Monocular Depth Estimation (MDE) is a fundamental 3D vision problem with numerous applications such as 3D scene reconstruction, autonomous navigation, and AI content creation. However, robust and generalizable MDE remains challenging due to limited real-world labeled data and distribution gaps between synthetic datasets and real data. Existing methods often struggle with real-world test data with low efficiency, reduced accuracy, and lack of detail. To address these issues, we propose an efficient MDE approach named FiffDepth. The key feature of FiffDepth is its use of diffusion priors. It transforms diffusion-based image generators into a feed-forward architecture for detailed depth estimation. FiffDepth preserves key generative features and integrates the strong generalization capabilities of models like DINOv2. Through benchmark evaluations, we demonstrate that FiffDepth achieves exceptional accuracy, stability, and fine-grained detail, offering significant improvements in MDE performance against state-of-the-art MDE approaches. The paper's source code is available here: https://yunpeng1998.github.io/FiffDepth/