LGAIJun 17, 2024

SpoT-Mamba: Learning Long-Range Dependency on Spatio-Temporal Graphs with Selective State Spaces

arXiv:2406.11244v19 citations
Originality Incremental advance
AI Analysis

This addresses a critical bottleneck in real-world applications like traffic forecasting, though it appears incremental as it adapts an existing method (Mamba) to a specific domain.

The paper tackles the challenge of modeling long-range spatio-temporal dependencies in spatio-temporal graph forecasting, proposing SpoT-Mamba, which improves performance on traffic forecasting datasets.

Spatio-temporal graph (STG) forecasting is a critical task with extensive applications in the real world, including traffic and weather forecasting. Although several recent methods have been proposed to model complex dynamics in STGs, addressing long-range spatio-temporal dependencies remains a significant challenge, leading to limited performance gains. Inspired by a recently proposed state space model named Mamba, which has shown remarkable capability of capturing long-range dependency, we propose a new STG forecasting framework named SpoT-Mamba. SpoT-Mamba generates node embeddings by scanning various node-specific walk sequences. Based on the node embeddings, it conducts temporal scans to capture long-range spatio-temporal dependencies. Experimental results on the real-world traffic forecasting dataset demonstrate the effectiveness of SpoT-Mamba.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes