CVLGJan 2, 2023

Archaeological Sites Detection with a Human-AI Collaboration Workflow

arXiv:2302.05286v11 citationsh-index: 37
Originality Synthesis-oriented
AI Analysis

This work addresses the problem of automating archaeological site detection for domain experts, though it is incremental as it applies existing methods to a specific dataset with human integration.

The paper tackles the detection of archaeological sites in Mesopotamian floodplains using fine-tuned semantic segmentation models, achieving about 80% detection accuracy in tests. It proposes a human-AI collaboration workflow where model predictions assist archaeologists in site analysis and dataset refinement.

This paper illustrates the results obtained by using pre-trained semantic segmentation deep learning models for the detection of archaeological sites within the Mesopotamian floodplains environment. The models were fine-tuned using openly available satellite imagery and vector shapes coming from a large corpus of annotations (i.e., surveyed sites). A randomized test showed that the best model reaches a detection accuracy in the neighborhood of 80%. Integrating domain expertise was crucial to define how to build the dataset and how to evaluate the predictions, since defining if a proposed mask counts as a prediction is very subjective. Furthermore, even an inaccurate prediction can be useful when put into context and interpreted by a trained archaeologist. Coming from these considerations we close the paper with a vision for a Human-AI collaboration workflow. Starting with an annotated dataset that is refined by the human expert we obtain a model whose predictions can either be combined to create a heatmap, to be overlaid on satellite and/or aerial imagery, or alternatively can be vectorized to make further analysis in a GIS software easier and automatic. In turn, the archaeologists can analyze the predictions, organize their onsite surveys, and refine the dataset with new, corrected, annotation

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes