Real-time Global Illumination for Dynamic 3D Gaussian Scenes
This work addresses the problem of achieving high-quality, real-time lighting effects for graphics researchers and developers, though it appears incremental by building on existing 3D Gaussian methods.
The paper tackles real-time global illumination for dynamic 3D Gaussian scenes by developing a pipeline with a surface light transport model, achieving over 40 fps in rendering with interactive material editing and multi-bounce lighting.
We present a real-time global illumination approach along with a pipeline for dynamic 3D Gaussian models and meshes. Building on a formulated surface light transport model for 3D Gaussians, we address key performance challenges with a fast compound stochastic ray-tracing algorithm and an optimized 3D Gaussian rasterizer. Our pipeline integrates multiple real-time techniques to accelerate performance and achieve high-quality lighting effects. Our approach enables real-time rendering of dynamic scenes with interactively editable materials and dynamic lighting of diverse multi-lights settings, capturing mutual multi-bounce light transport (indirect illumination) between 3D Gaussians and mesh. Additionally, we present a real-time renderer with an interactive user interface, validating our approach and demonstrating its practicality and high efficiency with over 40 fps in scenes including both 3D Gaussians and mesh. Furthermore, our work highlights the potential of 3D Gaussians in real-time applications with dynamic lighting, offering insights into performance and optimization.