CVDec 2, 2024

Horizon-GS: Unified 3D Gaussian Splatting for Large-Scale Aerial-to-Ground Scenes

arXiv:2412.01745v126 citationsh-index: 17CVPR
Originality Highly original
AI Analysis

This addresses the problem of limited immersive environments for applications requiring large-scale free-view exploration with both horizontal and vertical view changes.

The paper tackles the challenge of seamlessly integrating aerial and street view images for neural scene reconstruction and rendering, achieving high-fidelity unified scenes through a novel training strategy.

Seamless integration of both aerial and street view images remains a significant challenge in neural scene reconstruction and rendering. Existing methods predominantly focus on single domain, limiting their applications in immersive environments, which demand extensive free view exploration with large view changes both horizontally and vertically. We introduce Horizon-GS, a novel approach built upon Gaussian Splatting techniques, tackles the unified reconstruction and rendering for aerial and street views. Our method addresses the key challenges of combining these perspectives with a new training strategy, overcoming viewpoint discrepancies to generate high-fidelity scenes. We also curate a high-quality aerial-to-ground views dataset encompassing both synthetic and real-world scene to advance further research. Experiments across diverse urban scene datasets confirm the effectiveness of our method.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes