Mapping on a Budget: Optimizing Spatial Data Collection for ML
This addresses the challenge for scientists and policymakers in fields like agriculture and ecology who need efficient data collection to improve SatML monitoring, though it is incremental as it builds on existing SatML methods by focusing on data optimization.
The paper tackles the problem of sparse and clustered labeled training data in satellite imagery machine learning (SatML) by introducing the first optimization framework for spatial data collection under budget constraints, showing substantial gains from sample optimization in experiments across three continents and four tasks.
In applications across agriculture, ecology, and human development, machine learning with satellite imagery (SatML) is limited by the sparsity of labeled training data. While satellite data cover the globe, labeled training datasets for SatML are often small, spatially clustered, and collected for other purposes (e.g., administrative surveys or field measurements). Despite the pervasiveness of this issue in practice, past SatML research has largely focused on new model architectures and training algorithms to handle scarce training data, rather than modeling data conditions directly. This leaves scientists and policymakers who wish to use SatML for large-scale monitoring uncertain about whether and how to collect additional data to maximize performance. Here, we present the first problem formulation for the optimization of spatial training data in the presence of heterogeneous data collection costs and realistic budget constraints, as well as novel methods for addressing this problem. In experiments simulating different problem settings across three continents and four tasks, our strategies reveal substantial gains from sample optimization. Further experiments delineate settings for which optimized sampling is particularly effective. The problem formulation and methods we introduce are designed to generalize across application domains for SatML; we put special emphasis on a specific problem setting where our coauthors can immediately use our findings to augment clustered agricultural surveys for SatML monitoring in Togo.