Sparse Voxels Rasterization: Real-time High-fidelity Radiance Field Rendering
This addresses the problem of slow rendering speeds and artifacts in radiance field methods for novel-view synthesis, offering a neural-network-free approach with practical performance gains.
The paper tackles real-time high-fidelity radiance field rendering by proposing an efficient algorithm that uses adaptive sparse voxels with rasterization, achieving over 4dB PSNR improvement and more than 10x FPS speedup compared to previous neural-free voxel models.
We propose an efficient radiance field rendering algorithm that incorporates a rasterization process on adaptive sparse voxels without neural networks or 3D Gaussians. There are two key contributions coupled with the proposed system. The first is to adaptively and explicitly allocate sparse voxels to different levels of detail within scenes, faithfully reproducing scene details with $65536^3$ grid resolution while achieving high rendering frame rates. Second, we customize a rasterizer for efficient adaptive sparse voxels rendering. We render voxels in the correct depth order by using ray direction-dependent Morton ordering, which avoids the well-known popping artifact found in Gaussian splatting. Our method improves the previous neural-free voxel model by over 4db PSNR and more than 10x FPS speedup, achieving state-of-the-art comparable novel-view synthesis results. Additionally, our voxel representation is seamlessly compatible with grid-based 3D processing techniques such as Volume Fusion, Voxel Pooling, and Marching Cubes, enabling a wide range of future extensions and applications.