A Concept for Reconstructing Stucco Statues from historic Sketches using synthetic Data only
This addresses the challenge of cultural heritage preservation for historians and archaeologists, though it appears incremental as it builds on existing reconstruction methods with a focus on synthetic data.
The paper tackles the problem of reconstructing destroyed medieval stucco statues from historic sketches (sinopia) by proposing a fully-automated approach that generates point clouds, color images, depth maps, and surface normals from a single sketch, using only synthetic data for training and enabling real-time on-site reconstruction.
In medieval times, stuccoworkers used a red color, called sinopia, to first create a sketch of the to-be-made statue on the wall. Today, many of these statues are destroyed, but using the original drawings, deriving from the red color also called sinopia, we can reconstruct how the final statue might have looked.We propose a fully-automated approach to reconstruct a point cloud and show preliminary results by generating a color-image, a depth-map, as well as surface normals requiring only a single sketch, and without requiring a collection of other, similar samples. Our proposed solution allows real-time reconstruction on-site, for instance, within an exhibition, or to generate a useful starting point for an expert, trying to manually reconstruct the statue, all while using only synthetic data for training.