Towards Scaling Law Analysis For Spatiotemporal Weather Data
This work addresses the problem of scaling law analysis for weather forecasting, which is incremental as it extends existing methods to a more complex domain with specific implications for model training and resource allocation.
The authors tackled the challenge of applying scaling laws to spatiotemporal weather forecasting, where autoregressive rollouts and heterogeneous channels complicate analysis, and found strong heterogeneity across channels and horizons, with pooled metrics often masking degradation in specific channels at late leads.
Compute-optimal scaling laws are relatively well studied for NLP and CV, where objectives are typically single-step and targets are comparatively homogeneous. Weather forecasting is harder to characterize in the same framework: autoregressive rollouts compound errors over long horizons, outputs couple many physical channels with disparate scales and predictability, and globally pooled test metrics can disagree sharply with per-channel, late-lead behavior implied by short-horizon training. We extend neural scaling analysis for autoregressive weather forecasting from single-step training loss to long rollouts and per-channel metrics. We quantify (1) how prediction error is distributed across channels and how its growth rate evolves with forecast horizon, (2) if power law scaling holds for test error, relative to rollout length when error is pooled globally, and (3) how that fit varies jointly with horizon and channel for parameter, data, and compute-based scaling axes. We find strong cross-channel and cross-horizon heterogeneity: pooled scaling can look favorable while many channels degrade at late leads. We discuss implications for weighted objectives, horizon-aware curricula, and resource allocation across outputs.