CVIVJul 17, 2022

Source-free Unsupervised Domain Adaptation for Blind Image Quality Assessment

arXiv:2207.08124v214 citationsh-index: 12
Originality Incremental advance
AI Analysis

This addresses the practical issue of data privacy and storage in BIQA for applications requiring quality assessment without labeled target data, though it is incremental as it builds on existing UDA approaches.

The paper tackles the problem of domain shift in blind image quality assessment (BIQA) without access to source data, proposing a source-free unsupervised domain adaptation method that uses self-supervised objectives and Gaussian regularization, achieving effective mitigation of domain shift in cross-domain experiments.

Existing learning-based methods for blind image quality assessment (BIQA) are heavily dependent on large amounts of annotated training data, and usually suffer from a severe performance degradation when encountering the domain/distribution shift problem. Thanks to the development of unsupervised domain adaptation (UDA), some works attempt to transfer the knowledge from a label-sufficient source domain to a label-free target domain under domain shift with UDA. However, it requires the coexistence of source and target data, which might be impractical for source data due to the privacy or storage issues. In this paper, we take the first step towards the source-free unsupervised domain adaptation (SFUDA) in a simple yet efficient manner for BIQA to tackle the domain shift without access to the source data. Specifically, we cast the quality assessment task as a rating distribution prediction problem. Based on the intrinsic properties of BIQA, we present a group of well-designed self-supervised objectives to guide the adaptation of the BN affine parameters towards the target domain. Among them, minimizing the prediction entropy and maximizing the batch prediction diversity aim to encourage more confident results while avoiding the trivial solution. Besides, based on the observation that the IQA rating distribution of single image follows the Gaussian distribution, we apply Gaussian regularization to the predicted rating distribution to make it more consistent with the nature of human scoring. Extensive experimental results under cross-domain scenarios demonstrated the effectiveness of our proposed method to mitigate the domain shift.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes