ICME 2025 Generalizable HDR and SDR Video Quality Measurement Grand Challenge
This addresses the need for robust and generalizable VQA methods for video technology developers and researchers, but it is incremental as it benchmarks existing approaches rather than introducing a new method.
The paper reports on the ICME 2025 Grand Challenge, which tackled the problem of inconsistent Video Quality Assessment (VQA) performance across HDR and SDR content by benchmarking methods, resulting in four models outperforming the VMAF baseline and a top model achieving state-of-the-art performance.
This paper reports IEEE International Conference on Multimedia \& Expo (ICME) 2025 Grand Challenge on Generalizable HDR and SDR Video Quality Measurement. With the rapid development of video technology, especially High Dynamic Range (HDR) and Standard Dynamic Range (SDR) contents, the need for robust and generalizable Video Quality Assessment (VQA) methods has become increasingly demanded. Existing VQA models often struggle to deliver consistent performance across varying dynamic ranges, distortion types, and diverse content. This challenge was established to benchmark and promote VQA approaches capable of jointly handling HDR and SDR content. In the final evaluation phase, five teams submitted seven models along with technical reports to the Full Reference (FR) and No Reference (NR) tracks. Among them, four methods outperformed VMAF baseline, while the top-performing model achieved state-of-the-art performance, setting a new benchmark for generalizable video quality assessment.