InstantHDR: Single-forward Gaussian Splatting for High Dynamic Range 3D Reconstruction
This addresses the need for efficient HDR novel view synthesis without requiring known camera poses or time-consuming per-scene optimization, though it appears to be an incremental improvement over existing feed-forward approaches.
The paper tackles the problem of high dynamic range (HDR) 3D reconstruction from multi-exposure low dynamic range images, proposing InstantHDR which achieves comparable performance to state-of-the-art optimization-based methods while providing ~700× faster reconstruction in a single forward pass.
High dynamic range (HDR) novel view synthesis (NVS) aims to reconstruct HDR scenes from multi-exposure low dynamic range (LDR) images. Existing HDR pipelines heavily rely on known camera poses, well-initialized dense point clouds, and time-consuming per-scene optimization. Current feed-forward alternatives overlook the HDR problem by assuming exposure-invariant appearance. To bridge this gap, we propose InstantHDR, a feed-forward network that reconstructs 3D HDR scenes from uncalibrated multi-exposure LDR collections in a single forward pass. Specifically, we design a geometry-guided appearance modeling for multi-exposure fusion, and a meta-network for generalizable scene-specific tone mapping. Due to the lack of HDR scene data, we build a pre-training dataset, called HDR-Pretrain, for generalizable feed-forward HDR models, featuring 168 Blender-rendered scenes, diverse lighting types, and multiple camera response functions. Comprehensive experiments show that our InstantHDR delivers comparable synthesis performance to the state-of-the-art optimization-based HDR methods while enjoying $\sim700\times$ and $\sim20\times$ reconstruction speed improvement with our single-forward and post-optimization settings. All code, models, and datasets will be released after the review process.