CVJun 27, 2022

SARNet: Semantic Augmented Registration of Large-Scale Urban Point Clouds

arXiv:2206.13117v27 citationsh-index: 21Has Code
Originality Incremental advance
AI Analysis

This work addresses registration challenges for urban LiDAR data, offering a domain-specific solution that is incremental by building on existing learning-based methods with semantic augmentation.

The paper tackles the problem of registering large-scale urban point clouds, which is challenging due to noise and incompleteness, by proposing SARNet, a semantic augmented registration network that improves accuracy through semantic features, achieving efficient registration at city scale with real-world data comparisons.

Registering urban point clouds is a quite challenging task due to the large-scale, noise and data incompleteness of LiDAR scanning data. In this paper, we propose SARNet, a novel semantic augmented registration network aimed at achieving efficient registration of urban point clouds at city scale. Different from previous methods that construct correspondences only in the point-level space, our approach fully exploits semantic features as assistance to improve registration accuracy. Specifically, we extract per-point semantic labels with advanced semantic segmentation networks and build a prior semantic part-to-part correspondence. Then we incorporate the semantic information into a learning-based registration pipeline, consisting of three core modules: a semantic-based farthest point sampling module to efficiently filter out outliers and dynamic objects; a semantic-augmented feature extraction module for learning more discriminative point descriptors; a semantic-refined transformation estimation module that utilizes prior semantic matching as a mask to refine point correspondences by reducing false matching for better convergence. We evaluate the proposed SARNet extensively by using real-world data from large regions of urban scenes and comparing it with alternative methods. The code is available at https://github.com/WinterCodeForEverything/SARNet.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes