TraceFlow: Dynamic 3D Reconstruction of Specular Scenes Driven by Ray Tracing
This work improves rendering quality for dynamic specular scenes, which is important for applications like computer graphics and virtual reality, but it appears incremental as it builds on existing techniques like Gaussian splatting and ray tracing.
The paper tackled the problem of high-fidelity rendering of dynamic specular scenes by addressing reflection direction estimation and modeling, resulting in sharper and more realistic specular reflections that outperform prior methods on benchmarks.
We present TraceFlow, a novel framework for high-fidelity rendering of dynamic specular scenes by addressing two key challenges: precise reflection direction estimation and physically accurate reflection modeling. To achieve this, we propose a Residual Material-Augmented 2D Gaussian Splatting representation that models dynamic geometry and material properties, allowing accurate reflection ray computation. Furthermore, we introduce a Dynamic Environment Gaussian and a hybrid rendering pipeline that decomposes rendering into diffuse and specular components, enabling physically grounded specular synthesis via rasterization and ray tracing. Finally, we devise a coarse-to-fine training strategy to improve optimization stability and promote physically meaningful decomposition. Extensive experiments on dynamic scene benchmarks demonstrate that TraceFlow outperforms prior methods both quantitatively and qualitatively, producing sharper and more realistic specular reflections in complex dynamic environments.