CVJul 20, 2020

Learning Gaussian Instance Segmentation in Point Clouds

arXiv:2007.09860v161 citations
Originality Highly original
AI Analysis

This addresses instance segmentation in 3D point clouds for applications like robotics and autonomous driving, representing an incremental improvement with a novel method for a known bottleneck.

The paper tackles 3D instance segmentation in point clouds by proposing a Gaussian Instance Center Network (GICN) that approximates instance centers as Gaussian heatmaps, achieving state-of-the-art performance on ScanNet and S3DIS datasets.

This paper presents a novel method for instance segmentation of 3D point clouds. The proposed method is called Gaussian Instance Center Network (GICN), which can approximate the distributions of instance centers scattered in the whole scene as Gaussian center heatmaps. Based on the predicted heatmaps, a small number of center candidates can be easily selected for the subsequent predictions with efficiency, including i) predicting the instance size of each center to decide a range for extracting features, ii) generating bounding boxes for centers, and iii) producing the final instance masks. GICN is a single-stage, anchor-free, and end-to-end architecture that is easy to train and efficient to perform inference. Benefited from the center-dictated mechanism with adaptive instance size selection, our method achieves state-of-the-art performance in the task of 3D instance segmentation on ScanNet and S3DIS datasets.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes