CVJul 20

Fine-Detail Monocular Geometry Estimation with Self-Guided Sparse Volumetric Refinement

arXiv:2607.179678.92 citations
Predicted impact top 44% in CV · last 90 daysOriginality Incremental advance
AI Analysis

Addresses fine-detail distortion in monocular geometry estimation, a key bottleneck for 3D reconstruction from single images.

Monocular geometry estimation suffers from distortion in fine 3D details due to architectural mismatch. The proposed Self-Guided Sparse 3D Refinement (SSR) lifts geometry to 3D space and refines it with sparse convolutions, achieving significant improvements over existing methods on diverse datasets.

Monocular geometry estimation has recently achieved impressive performance across diverse scenes. However, state-of-the-art models still face notable distortion in local 3D structure, especially in fine details, like thin structures and small objects. We attribute this limitation to an architectural mismatch: most current models decode 3D geometry within a 2D parameterization, where feature interactions are governed by image-plane proximity rather than true 3D spatial relationships. This inadvertently mixes features from geometrically distant surfaces, resulting in over-smoothed geometry particularly around thin or elongated structure. In this paper, we propose a fine-detail monocular geometry estimation with Self-Guided Sparse 3D Refinement (SSR) that lifts monocular geometry modeling from 2D image space to 3D space for high-fidelity metric-scale point maps. Our model lifts the coarse point map from a foundation base model onto a sparse voxel shell and refines it via SSR. The SSR employs sparse convolutions that aggregate features based on 3D spatial locality, avoiding feature mixing across depth discontinuities. Extensive experiments on diverse datasets demonstrate that our method significantly outperforms existing approaches in recovering fine detailed 3D geometry across both quantitative metrics and qualitative visualizations.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes