CVMar 23, 2021

Dual Mesh Convolutional Networks for Human Shape Correspondence

arXiv:2103.12459v25 citations
AI Analysis

This work addresses shape correspondence for 3D human models, offering an incremental improvement by leveraging dual meshes to handle irregular data structures more effectively.

The paper tackled the problem of applying convolutional networks to irregular triangular meshes by proposing a dual, face-based representation, which improved shape correspondence results on the Faust human shape dataset and showed greater robustness to mesh topology changes.

Convolutional networks have been extremely successful for regular data structures such as 2D images and 3D voxel grids. The transposition to meshes is, however, not straight-forward due to their irregular structure. We explore how the dual, face-based representation of triangular meshes can be leveraged as a data structure for graph convolutional networks. In the dual mesh, each node (face) has a fixed number of neighbors, which makes the networks less susceptible to overfitting on the mesh topology, and also al-lows the use of input features that are naturally defined over faces, such as surface normals and face areas. We evaluate the dual approach on the shape correspondence task on theFaust human shape dataset and variants of it with differ-ent mesh topologies. Our experiments show that results of graph convolutional networks improve when defined over the dual rather than primal mesh. Moreover, our models that explicitly leverage the neighborhood regularity of dual meshes allow improving results further while being more robust to changes in the mesh topology.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes