LaVIDE: A Language-Vision Discriminator for Detecting Changes in Satellite Image with Map References
This addresses a challenge in remote sensing and geospatial analysis by enabling change detection with limited data, though it is incremental as it builds on existing methods for a specific bottleneck.
The paper tackles the problem of detecting changes in satellite images when only a single image is available by comparing it with an existing map, using a language-vision discriminator to bridge the abstraction gap between maps and images. The result shows that their method outperforms state-of-the-art algorithms, achieving gains of about 13.8% on the DynamicEarthNet dataset and 4.3% on the SECOND dataset.
Change detection, which typically relies on the comparison of bi-temporal images, is significantly hindered when only a single image is available. Comparing a single image with an existing map, such as OpenStreetMap, which is continuously updated through crowd-sourcing, offers a viable solution to this challenge. Unlike images that carry low-level visual details of ground objects, maps convey high-level categorical information. This discrepancy in abstraction levels complicates the alignment and comparison of the two data types. In this paper, we propose a \textbf{La}nguage-\textbf{VI}sion \textbf{D}iscriminator for d\textbf{E}tecting changes in satellite image with map references, namely \ours{}, which leverages language to bridge the information gap between maps and images. Specifically, \ours{} formulates change detection as the problem of ``{\textit Does the pixel belong to [class]?}'', aligning maps and images within the feature space of the language-vision model to associate high-level map categories with low-level image details. Moreover, we build a mixture-of-experts discriminative module, which compares linguistic features from maps with visual features from images across various semantic perspectives, achieving comprehensive semantic comparison for change detection. Extensive evaluation on four benchmark datasets demonstrates that \ours{} can effectively detect changes in satellite image with map references, outperforming state-of-the-art change detection algorithms, e.g., with gains of about $13.8$\% on the DynamicEarthNet dataset and $4.3$\% on the SECOND dataset.