DMesh: A Differentiable Mesh Representation
This provides a novel method for 3D reconstruction tasks in computer vision and graphics, though it appears incremental as it builds on existing triangulation techniques.
The paper tackles the problem of representing 3D triangular meshes in a differentiable way, enabling gradient-based optimization for mesh reconstruction from point clouds and multi-view images.
We present a differentiable representation, DMesh, for general 3D triangular meshes. DMesh considers both the geometry and connectivity information of a mesh. In our design, we first get a set of convex tetrahedra that compactly tessellates the domain based on Weighted Delaunay Triangulation (WDT), and select triangular faces on the tetrahedra to define the final mesh. We formulate probability of faces to exist on the actual surface in a differentiable manner based on the WDT. This enables DMesh to represent meshes of various topology in a differentiable way, and allows us to reconstruct the mesh under various observations, such as point cloud and multi-view images using gradient-based optimization. The source code and full paper is available at: https://sonsang.github.io/dmesh-project.