CVJul 11, 2023

Hyperspherical Embedding for Point Cloud Completion

arXiv:2307.05634v17 citationsh-index: 39Has Code
Originality Incremental advance
AI Analysis

This work addresses the issue of sparse embedding distributions in point cloud completion for 3D vision applications, offering an incremental improvement over existing encoder-decoder methods.

The paper tackled the problem of incomplete 3D point clouds from depth sensors by proposing a hyperspherical module to normalize embeddings onto a unit hypersphere, decoupling magnitude and direction to improve generalization, resulting in consistent improvements in point cloud completion tasks.

Most real-world 3D measurements from depth sensors are incomplete, and to address this issue the point cloud completion task aims to predict the complete shapes of objects from partial observations. Previous works often adapt an encoder-decoder architecture, where the encoder is trained to extract embeddings that are used as inputs to generate predictions from the decoder. However, the learned embeddings have sparse distribution in the feature space, which leads to worse generalization results during testing. To address these problems, this paper proposes a hyperspherical module, which transforms and normalizes embeddings from the encoder to be on a unit hypersphere. With the proposed module, the magnitude and direction of the output hyperspherical embedding are decoupled and only the directional information is optimized. We theoretically analyze the hyperspherical embedding and show that it enables more stable training with a wider range of learning rates and more compact embedding distributions. Experiment results show consistent improvement of point cloud completion in both single-task and multi-task learning, which demonstrates the effectiveness of the proposed method.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes