Rip-NeRF: Anti-aliasing Radiance Fields with Ripmap-Encoded Platonic Solids
This addresses rendering quality issues in 3D scene reconstruction for computer vision and graphics applications, representing an incremental improvement over existing NeRF methods.
The paper tackles aliasing and blurring artifacts in Neural Radiance Fields (NeRFs) by introducing a Ripmap-Encoded Platonic Solid representation, achieving state-of-the-art rendering quality with high-fidelity anti-aliasing, particularly in fine details, while maintaining relatively swift training times.
Despite significant advancements in Neural Radiance Fields (NeRFs), the renderings may still suffer from aliasing and blurring artifacts, since it remains a fundamental challenge to effectively and efficiently characterize anisotropic areas induced by the cone-casting procedure. This paper introduces a Ripmap-Encoded Platonic Solid representation to precisely and efficiently featurize 3D anisotropic areas, achieving high-fidelity anti-aliasing renderings. Central to our approach are two key components: Platonic Solid Projection and Ripmap encoding. The Platonic Solid Projection factorizes the 3D space onto the unparalleled faces of a certain Platonic solid, such that the anisotropic 3D areas can be projected onto planes with distinguishable characterization. Meanwhile, each face of the Platonic solid is encoded by the Ripmap encoding, which is constructed by anisotropically pre-filtering a learnable feature grid, to enable featurzing the projected anisotropic areas both precisely and efficiently by the anisotropic area-sampling. Extensive experiments on both well-established synthetic datasets and a newly captured real-world dataset demonstrate that our Rip-NeRF attains state-of-the-art rendering quality, particularly excelling in the fine details of repetitive structures and textures, while maintaining relatively swift training times.