CVNov 30, 2020

Monocular 3D Object Detection with Sequential Feature Association and Depth Hint Augmentation

arXiv:2011.14589v440 citations
AI Analysis

This work aims to improve monocular 3D object detection for autonomous driving, offering an incremental advancement over existing keypoint-based methods.

This paper addresses monocular 3D object detection for autonomous driving by proposing FADNet, a unified network that sequentially associates output modalities using a convolutional Gated Recurrent Unit. It also introduces a depth hint augmentation strategy, generating row-wise features to improve depth estimation, achieving competitive performance on the KITTI benchmark without depth priors or post-optimization.

Monocular 3D object detection, with the aim of predicting the geometric properties of on-road objects, is a promising research topic for the intelligent perception systems of autonomous driving. Most state-of-the-art methods follow a keypoint-based paradigm, where the keypoints of objects are predicted and employed as the basis for regressing the other geometric properties. In this work, a unified network named as FADNet is presented to address the task of monocular 3D object detection. In contrast to previous keypoint-based methods, we propose to divide the output modalities into different groups according to the estimation difficulty of object properties. Different groups are treated differently and sequentially associated by a convolutional Gated Recurrent Unit. Another contribution of this work is the strategy of depth hint augmentation. To provide characterized depth patterns as hints for depth estimation, a dedicated depth hint module is designed to generate row-wise features named as depth hints, which are explicitly supervised in a bin-wise manner. The contributions of this work are validated by conducting experiments and ablation study on the KITTI benchmark. Without utilizing depth priors, post optimization, or other refinement modules, our network performs competitively against state-of-the-art methods while maintaining a decent running speed.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes