WaveMAE: Wavelet decomposition Masked Auto-Encoder for Remote Sensing
This addresses the scarcity of annotated data in remote sensing by providing a geographically informed foundation model for multispectral imagery, though it is incremental as it builds on existing masked autoencoding frameworks.
The paper tackled the problem of self-supervised learning for multispectral satellite imagery by introducing WaveMAE, which uses wavelet decomposition and geo-conditioned encoding to achieve consistent improvements over prior state-of-the-art methods, with substantial gains on segmentation and regression benchmarks and a lightweight variant achieving SOTA performance with only 26.4% of parameters.
Self-supervised learning (SSL) has recently emerged as a key strategy for building foundation models in remote sensing, where the scarcity of annotated data limits the applicability of fully supervised approaches. In this work, we introduce WaveMAE, a masked autoencoding framework tailored for multispectral satellite imagery. Unlike conventional pixel-based reconstruction, WaveMAE leverages a multi-level Discrete Wavelet Transform (DWT) to disentangle frequency components and guide the encoder toward learning scale-aware high-frequency representations. We further propose a Geo-conditioned Positional Encoding (GPE), which incorporates geographical priors via Spherical Harmonics, encouraging embeddings that respect both semantic and geospatial structure. To ensure fairness in evaluation, all methods are pretrained on the same dataset (fMoW-S2) and systematically evaluated on the diverse downstream tasks of the PANGAEA benchmark, spanning semantic segmentation, regression, change detection, and multilabel classification. Extensive experiments demonstrate that WaveMAE achieves consistent improvements over prior state-of-the-art approaches, with substantial gains on segmentation and regression benchmarks. The effectiveness of WaveMAE pretraining is further demonstrated by showing that even a lightweight variant, containing only 26.4% of the parameters, achieves state-of-the-art performance. Our results establish WaveMAE as a strong and geographically informed foundation model for multispectral remote sensing imagery.