Fusing Forces: Deep-Human-Guided Refinement of Segmentation Masks
This addresses the labor-intensive task of segmenting intricate lines in Etruscan art documentation, with potential broader applications, though it appears incremental as it builds on prior automation methods.
The paper tackles the problem of manually tracing illustrations on Etruscan mirrors by proposing a deep neural network that interactively refines existing annotations based on human guidance, achieving equal quality with up to 75% less manual input and up to 26% relative improvement over pure manual labeling.
Etruscan mirrors constitute a significant category in Etruscan art, characterized by elaborate figurative illustrations featured on their backside. A laborious and costly aspect of their analysis and documentation is the task of manually tracing these illustrations. In previous work, a methodology has been proposed to automate this process, involving photometric-stereo scanning in combination with deep neural networks. While achieving quantitative performance akin to an expert annotator, some results still lack qualitative precision and, thus, require annotators for inspection and potential correction, maintaining resource intensity. In response, we propose a deep neural network trained to interactively refine existing annotations based on human guidance. Our human-in-the-loop approach streamlines annotation, achieving equal quality with up to 75% less manual input required. Moreover, during the refinement process, the relative improvement of our methodology over pure manual labeling reaches peak values of up to 26%, attaining drastically better quality quicker. By being tailored to the complex task of segmenting intricate lines, specifically distinguishing it from previous methods, our approach offers drastic improvements in efficacy, transferable to a broad spectrum of applications beyond Etruscan mirrors.