Radiant: Large-scale 3D Gaussian Rendering based on Hierarchical Framework
This work addresses computational and communication bottlenecks for deploying 3DGS on edge devices, offering a solution for efficient large-scale scene reconstruction, though it appears incremental as it builds on existing 3DGS methods.
The paper tackled the challenge of large-scale 3D Gaussian Splatting (3DGS) scene reconstruction in distributed environments by proposing Radiant, a hierarchical algorithm that improved reconstruction quality by up to 25.7% and reduced end-to-end latency by up to 79.6%.
With the advancement of computer vision, the recently emerged 3D Gaussian Splatting (3DGS) has increasingly become a popular scene reconstruction algorithm due to its outstanding performance. Distributed 3DGS can efficiently utilize edge devices to directly train on the collected images, thereby offloading computational demands and enhancing efficiency. However, traditional distributed frameworks often overlook computational and communication challenges in real-world environments, hindering large-scale deployment and potentially posing privacy risks. In this paper, we propose Radiant, a hierarchical 3DGS algorithm designed for large-scale scene reconstruction that considers system heterogeneity, enhancing the model performance and training efficiency. Via extensive empirical study, we find that it is crucial to partition the regions for each edge appropriately and allocate varying camera positions to each device for image collection and training. The core of Radiant is partitioning regions based on heterogeneous environment information and allocating workloads to each device accordingly. Furthermore, we provide a 3DGS model aggregation algorithm that enhances the quality and ensures the continuity of models' boundaries. Finally, we develop a testbed, and experiments demonstrate that Radiant improved reconstruction quality by up to 25.7\% and reduced up to 79.6\% end-to-end latency.