CVMar 14, 2023

Modeling Continuous Motion for 3D Point Cloud Object Tracking

arXiv:2303.07605v210 citationsh-index: 68
Originality Highly original
AI Analysis

This work addresses a key limitation in 3D object tracking for applications like autonomous driving and robotics by improving accuracy through continuous motion modeling.

The paper tackles the problem of 3D single object tracking in LiDAR point clouds by modeling continuous motion across multiple frames, rather than relying on appearance matching or two-frame motion modeling, and demonstrates that the proposed method outperforms state-of-the-art approaches on multiple benchmarks.

The task of 3D single object tracking (SOT) with LiDAR point clouds is crucial for various applications, such as autonomous driving and robotics. However, existing approaches have primarily relied on appearance matching or motion modeling within only two successive frames, thereby overlooking the long-range continuous motion property of objects in 3D space. To address this issue, this paper presents a novel approach that views each tracklet as a continuous stream: at each timestamp, only the current frame is fed into the network to interact with multi-frame historical features stored in a memory bank, enabling efficient exploitation of sequential information. To achieve effective cross-frame message passing, a hybrid attention mechanism is designed to account for both long-range relation modeling and local geometric feature extraction. Furthermore, to enhance the utilization of multi-frame features for robust tracking, a contrastive sequence enhancement strategy is proposed, which uses ground truth tracklets to augment training sequences and promote discrimination against false positives in a contrastive manner. Extensive experiments demonstrate that the proposed method outperforms the state-of-the-art method by significant margins on multiple benchmarks.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes