3DBooSTeR: 3D Body Shape and Texture Recovery
This addresses the need for realistic digital human representations in virtual and augmented reality, but it is incremental as it builds on existing mesh completion techniques.
The authors tackled the problem of recovering a textured 3D body mesh from partial 3D scans by proposing 3DBooSTeR, which decouples shape and texture completion into sequential tasks, achieving results validated on the 3DBodyTex.v2 dataset.
We propose 3DBooSTeR, a novel method to recover a textured 3D body mesh from a textured partial 3D scan. With the advent of virtual and augmented reality, there is a demand for creating realistic and high-fidelity digital 3D human representations. However, 3D scanning systems can only capture the 3D human body shape up to some level of defects due to its complexity, including occlusion between body parts, varying levels of details, shape deformations and the articulated skeleton. Textured 3D mesh completion is thus important to enhance 3D acquisitions. The proposed approach decouples the shape and texture completion into two sequential tasks. The shape is recovered by an encoder-decoder network deforming a template body mesh. The texture is subsequently obtained by projecting the partial texture onto the template mesh before inpainting the corresponding texture map with a novel approach. The approach is validated on the 3DBodyTex.v2 dataset.