CVAIMar 31, 2022

3D Equivariant Graph Implicit Functions

arXiv:2203.17178v130 citations
Originality Highly original
AI Analysis

This work addresses the problem of robust 3D shape modeling for computer vision and graphics applications, representing an incremental advance with specific gains in transformation generalization.

The paper tackles the limitations of neural implicit representations in capturing local 3D geometric details and generalizing to unseen 3D transformations by introducing a novel family of graph implicit functions with equivariant layers, achieving an improvement from 0.69 to 0.89 IoU on ShapeNet reconstruction.

In recent years, neural implicit representations have made remarkable progress in modeling of 3D shapes with arbitrary topology. In this work, we address two key limitations of such representations, in failing to capture local 3D geometric fine details, and to learn from and generalize to shapes with unseen 3D transformations. To this end, we introduce a novel family of graph implicit functions with equivariant layers that facilitates modeling fine local details and guaranteed robustness to various groups of geometric transformations, through local $k$-NN graph embeddings with sparse point set observations at multiple resolutions. Our method improves over the existing rotation-equivariant implicit function from 0.69 to 0.89 (IoU) on the ShapeNet reconstruction task. We also show that our equivariant implicit function can be extended to other types of similarity transformations and generalizes to unseen translations and scaling.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes