CVJul 18, 2023

MLF-DET: Multi-Level Fusion for Cross-Modal 3D Object Detection

arXiv:2307.09155v113 citationsh-index: 17
Originality Incremental advance
AI Analysis

This addresses 3D object detection for autonomous driving by improving accuracy through multi-modal fusion, though it appears incremental as it builds on existing fusion approaches.

The paper tackled cross-modal 3D object detection by proposing MLF-DET, which integrates feature-level and decision-level fusion with image data, achieving 82.89% moderate AP on the KITTI car benchmark and state-of-the-art performance.

In this paper, we propose a novel and effective Multi-Level Fusion network, named as MLF-DET, for high-performance cross-modal 3D object DETection, which integrates both the feature-level fusion and decision-level fusion to fully utilize the information in the image. For the feature-level fusion, we present the Multi-scale Voxel Image fusion (MVI) module, which densely aligns multi-scale voxel features with image features. For the decision-level fusion, we propose the lightweight Feature-cued Confidence Rectification (FCR) module which further exploits image semantics to rectify the confidence of detection candidates. Besides, we design an effective data augmentation strategy termed Occlusion-aware GT Sampling (OGS) to reserve more sampled objects in the training scenes, so as to reduce overfitting. Extensive experiments on the KITTI dataset demonstrate the effectiveness of our method. Notably, on the extremely competitive KITTI car 3D object detection benchmark, our method reaches 82.89% moderate AP and achieves state-of-the-art performance without bells and whistles.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes