CVSep 15, 2022

Self-distilled Feature Aggregation for Self-supervised Monocular Depth Estimation

arXiv:2209.07088v139 citationsh-index: 17Has Code
Originality Incremental advance
AI Analysis

This work addresses a specific bottleneck in computer vision for depth estimation, offering an incremental improvement over existing methods.

The paper tackles the problem of contextual inconsistency in multi-scale feature aggregation for self-supervised monocular depth estimation by proposing a Self-Distilled Feature Aggregation (SDFA) module, resulting in improved performance that outperforms state-of-the-art methods on the KITTI dataset in most cases.

Self-supervised monocular depth estimation has received much attention recently in computer vision. Most of the existing works in literature aggregate multi-scale features for depth prediction via either straightforward concatenation or element-wise addition, however, such feature aggregation operations generally neglect the contextual consistency between multi-scale features. Addressing this problem, we propose the Self-Distilled Feature Aggregation (SDFA) module for simultaneously aggregating a pair of low-scale and high-scale features and maintaining their contextual consistency. The SDFA employs three branches to learn three feature offset maps respectively: one offset map for refining the input low-scale feature and the other two for refining the input high-scale feature under a designed self-distillation manner. Then, we propose an SDFA-based network for self-supervised monocular depth estimation, and design a self-distilled training strategy to train the proposed network with the SDFA module. Experimental results on the KITTI dataset demonstrate that the proposed method outperforms the comparative state-of-the-art methods in most cases. The code is available at https://github.com/ZM-Zhou/SDFA-Net_pytorch.

Code Implementations2 repos
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes