CVSep 15, 2024

MesonGS: Post-training Compression of 3D Gaussians via Efficient Attribute Transformation

arXiv:2409.09756v151 citationsh-index: 6
Originality Incremental advance
AI Analysis

This work addresses storage and transmission challenges for 3D Gaussian models in practical applications like VR/AR, though it is incremental as it builds on existing compression techniques.

The paper tackles the large file size problem of 3D Gaussian Splatting models for novel view synthesis by proposing MesonGS, a post-training compression method that reduces model size by up to 10x while maintaining competitive rendering quality.

3D Gaussian Splatting demonstrates excellent quality and speed in novel view synthesis. Nevertheless, the huge file size of the 3D Gaussians presents challenges for transmission and storage. Current works design compact models to replace the substantial volume and attributes of 3D Gaussians, along with intensive training to distill information. These endeavors demand considerable training time, presenting formidable hurdles for practical deployment. To this end, we propose MesonGS, a codec for post-training compression of 3D Gaussians. Initially, we introduce a measurement criterion that considers both view-dependent and view-independent factors to assess the impact of each Gaussian point on the rendering output, enabling the removal of insignificant points. Subsequently, we decrease the entropy of attributes through two transformations that complement subsequent entropy coding techniques to enhance the file compression rate. More specifically, we first replace rotation quaternions with Euler angles; then, we apply region adaptive hierarchical transform to key attributes to reduce entropy. Lastly, we adopt finer-grained quantization to avoid excessive information loss. Moreover, a well-crafted finetune scheme is devised to restore quality. Extensive experiments demonstrate that MesonGS significantly reduces the size of 3D Gaussians while preserving competitive quality.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes