ZAYAN: Disentangled Contrastive Transformer for Tabular Remote Sensing Data
For practitioners working with tabular remote sensing data, ZAYAN offers a method to learn informative representations without labels, addressing challenges like heterogeneity and feature redundancy.
ZAYAN introduces a self-supervised contrastive framework for tabular remote sensing data that operates at the feature level, eliminating the need for anchor selection and class labels. It achieves superior accuracy, robustness, and generalization across eight datasets, with consistent gains under label scarcity and distribution shift.
Learning informative representations from tabular data in remote sensing and environmental science is challenging due to heterogeneity, scarce labels, and redundancy among features. We present ZAYAN (Zero-Anchor dYnamic feAture eNcoding), a self-supervised, feature-centric contrastive framework for tabular data. ZAYAN performs contrastive learning at the feature rather than sample level, removing the need for explicit anchor selection and any reliance on class labels, while encouraging a redundancy-minimized, disentangled embedding space. The framework has two modules: ZAYAN-CL, which pretrains feature embeddings via a zero-anchor contrastive objective with dynamic perturbations and masking, and ZAYAN-T, a Transformer that conditions on these embeddings for downstream classification. Across eight datasets, including six remote-sensing tabular benchmarks and two remote-sensing-driven flood-prediction tables from satellite and GIS products, ZAYAN achieves superior accuracy, robustness, and generalization over tabular deep learning baselines, with consistent gains under label scarcity and distribution shift. These results indicate that feature-level contrastive learning and dynamic feature encoding provide an effective recipe for learning from tabular sensing data.