Distortion-Aware Loop Filtering of Intra 360^o Video Coding with Equirectangular Projection
This work addresses video compression efficiency for 360° content, which is incremental as it builds on existing coding standards with specific enhancements.
The paper tackles the problem of improving intra coding performance for 360° videos in equirectangular projection format by proposing a distortion-aware loop filtering model, achieving average bitrate savings of 7.1% to 9.0% compared to the anchor method.
In this paper, we propose a distortion-aware loop filtering model to improve the performance of intra coding for 360$^o$ videos projected via equirectangular projection (ERP) format. To enable the awareness of distortion, our proposed module analyzes content characteristics based on a coding unit (CU) partition mask and processes them through partial convolution to activate the specified area. The feature recalibration module, which leverages cascaded residual channel-wise attention blocks (RCABs) to adjust the inter-channel and intra-channel features automatically, is capable of adapting with different quality levels. The perceptual geometry optimization combining with weighted mean squared error (WMSE) and the perceptual loss guarantees both the local field of view (FoV) and global image reconstruction with high quality. Extensive experimental results show that our proposed scheme achieves significant bitrate savings compared with the anchor (HM + 360Lib), leading to 8.9%, 9.0%, 7.1% and 7.4% on average bit rate reductions in terms of PSNR, WPSNR, and PSNR of two viewports for luminance component of 360^o videos, respectively.