Ear-to-ear Capture of Facial Intrinsics
This provides a practical solution for creating detailed face models in graphics and VR, though it is incremental as it builds on hybrid techniques.
The paper tackles the problem of capturing complete, relightable 3D face models from ear to ear by combining geometric and photometric methods without geometric calibration, resulting in photorealistic renderings from any viewpoint.
We present a practical approach to capturing ear-to-ear face models comprising both 3D meshes and intrinsic textures (i.e. diffuse and specular albedo). Our approach is a hybrid of geometric and photometric methods and requires no geometric calibration. Photometric measurements made in a lightstage are used to estimate view dependent high resolution normal maps. We overcome the problem of having a single photometric viewpoint by capturing in multiple poses. We use uncalibrated multiview stereo to estimate a coarse base mesh to which the photometric views are registered. We propose a novel approach to robustly stitching surface normal and intrinsic texture data into a seamless, complete and highly detailed face model. The resulting relightable models provide photorealistic renderings in any view.