DeepAVO: Efficient Pose Refining with Feature Distilling for Deep Visual Odometry
This work addresses pose estimation for autonomous driving and robotics, offering an incremental improvement over existing learning-based methods.
The paper tackled monocular visual odometry by proposing DeepAVO, a deep learning method that uses a four-branch network with channel-spatial attention to estimate motion from optical flow, achieving state-of-the-art performance on various datasets and demonstrating competitive results compared to stereo methods.
The technology for Visual Odometry (VO) that estimates the position and orientation of the moving object through analyzing the image sequences captured by on-board cameras, has been well investigated with the rising interest in autonomous driving. This paper studies monocular VO from the perspective of Deep Learning (DL). Unlike most current learning-based methods, our approach, called DeepAVO, is established on the intuition that features contribute discriminately to different motion patterns. Specifically, we present a novel four-branch network to learn the rotation and translation by leveraging Convolutional Neural Networks (CNNs) to focus on different quadrants of optical flow input. To enhance the ability of feature selection, we further introduce an effective channel-spatial attention mechanism to force each branch to explicitly distill related information for specific Frame to Frame (F2F) motion estimation. Experiments on various datasets involving outdoor driving and indoor walking scenarios show that the proposed DeepAVO outperforms the state-of-the-art monocular methods by a large margin, demonstrating competitive performance to the stereo VO algorithm and verifying promising potential for generalization.