CVAug 21, 2020

PointNetLK Revisited

arXiv:2008.09527v217 citations
Originality Incremental advance
AI Analysis

This addresses the generalization problem for point cloud registration in robotics and computer vision, offering an incremental improvement over hybrid methods.

The paper tackles the poor generalization of learning-based point cloud registration methods to mismatched conditions, showing that adding an analytical Jacobian to PointNetLK achieves state-of-the-art performance in mismatched scenarios and competitive results on real-world data.

We address the generalization ability of recent learning-based point cloud registration methods. Despite their success, these approaches tend to have poor performance when applied to mismatched conditions that are not well-represented in the training set, such as unseen object categories, different complex scenes, or unknown depth sensors. In these circumstances, it has often been better to rely on classical non-learning methods (e.g., Iterative Closest Point), which have better generalization ability. Hybrid learning methods, that use learning for predicting point correspondences and then a deterministic step for alignment, have offered some respite, but are still limited in their generalization abilities. We revisit a recent innovation -- PointNetLK -- and show that the inclusion of an analytical Jacobian can exhibit remarkable generalization properties while reaping the inherent fidelity benefits of a learning framework. Our approach not only outperforms the state-of-the-art in mismatched conditions but also produces results competitive with current learning methods when operating on real-world test data close to the training set.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes