CVAILGJul 9, 2022

Few 'Zero Level Set'-Shot Learning of Shape Signed Distance Functions in Feature Space

arXiv:2207.04161v124 citationsh-index: 13
Originality Incremental advance
AI Analysis

This work addresses shape reconstruction for computer vision and graphics, offering an incremental improvement by integrating two conditioning mechanisms.

The paper tackles shape reconstruction from sparse point clouds by proposing a few-shot learning approach for implicit neural signed distance functions in feature space, combining feature encoding and meta-learning, and shows it outperforms existing methods in numerical and qualitative evaluations.

We explore a new idea for learning based shape reconstruction from a point cloud, based on the recently popularized implicit neural shape representations. We cast the problem as a few-shot learning of implicit neural signed distance functions in feature space, that we approach using gradient based meta-learning. We use a convolutional encoder to build a feature space given the input point cloud. An implicit decoder learns to predict signed distance values given points represented in this feature space. Setting the input point cloud, i.e. samples from the target shape function's zero level set, as the support (i.e. context) in few-shot learning terms, we train the decoder such that it can adapt its weights to the underlying shape of this context with a few (5) tuning steps. We thus combine two types of implicit neural network conditioning mechanisms simultaneously for the first time, namely feature encoding and meta-learning. Our numerical and qualitative evaluation shows that in the context of implicit reconstruction from a sparse point cloud, our proposed strategy, i.e. meta-learning in feature space, outperforms existing alternatives, namely standard supervised learning in feature space, and meta-learning in euclidean space, while still providing fast inference.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes