CVJun 17, 2025

3DGS-IEval-15K: A Large-scale Image Quality Evaluation Database for 3D Gaussian-Splatting

arXiv:2506.14642v26 citationsh-index: 17Has CodeMM
Originality Synthesis-oriented
AI Analysis

This work provides a foundational dataset for developing specialized image quality metrics in 3DGS, addressing a domain-specific problem for researchers and practitioners in novel view synthesis.

The paper tackles the lack of a comprehensive framework to evaluate the perceptual impact of compression in 3D Gaussian Splatting (3DGS) methods by introducing 3DGS-IEval-15K, a large-scale image quality assessment dataset with 15,200 images from 10 scenes, 6 algorithms, and 20 viewpoints, validated through subjective experiments with 60 viewers.

3D Gaussian Splatting (3DGS) has emerged as a promising approach for novel view synthesis, offering real-time rendering with high visual fidelity. However, its substantial storage requirements present significant challenges for practical applications. While recent state-of-the-art (SOTA) 3DGS methods increasingly incorporate dedicated compression modules, there is a lack of a comprehensive framework to evaluate their perceptual impact. Therefore we present 3DGS-IEval-15K, the first large-scale image quality assessment (IQA) dataset specifically designed for compressed 3DGS representations. Our dataset encompasses 15,200 images rendered from 10 real-world scenes through 6 representative 3DGS algorithms at 20 strategically selected viewpoints, with different compression levels leading to various distortion effects. Through controlled subjective experiments, we collect human perception data from 60 viewers. We validate dataset quality through scene diversity and MOS distribution analysis, and establish a comprehensive benchmark with 30 representative IQA metrics covering diverse types. As the largest-scale 3DGS quality assessment dataset to date, our work provides a foundation for developing 3DGS specialized IQA metrics, and offers essential data for investigating view-dependent quality distribution patterns unique to 3DGS. The database is publicly available at https://github.com/YukeXing/3DGS-IEval-15K.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes