CVApr 24, 2023

Grad-PU: Arbitrary-Scale Point Cloud Upsampling via Gradient Descent with Learned Distance Functions

arXiv:2304.11846v197 citationsh-index: 56
Originality Incremental advance
AI Analysis

This addresses the need for flexible and high-quality point cloud upsampling in applications like 3D reconstruction and computer vision, though it is an incremental improvement over existing methods.

The paper tackles the problem of point cloud upsampling with fixed rates and artifacts by proposing a framework that supports arbitrary upsampling rates through gradient descent and learned distance functions, achieving state-of-the-art accuracy and efficiency on benchmarks.

Most existing point cloud upsampling methods have roughly three steps: feature extraction, feature expansion and 3D coordinate prediction. However,they usually suffer from two critical issues: (1)fixed upsampling rate after one-time training, since the feature expansion unit is customized for each upsampling rate; (2)outliers or shrinkage artifact caused by the difficulty of precisely predicting 3D coordinates or residuals of upsampled points. To adress them, we propose a new framework for accurate point cloud upsampling that supports arbitrary upsampling rates. Our method first interpolates the low-res point cloud according to a given upsampling rate. And then refine the positions of the interpolated points with an iterative optimization process, guided by a trained model estimating the difference between the current point cloud and the high-res target. Extensive quantitative and qualitative results on benchmarks and downstream tasks demonstrate that our method achieves the state-of-the-art accuracy and efficiency.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes