FLaRA: Predicting Future Latent Representations for Accident Anticipation
For intelligent transportation systems, this work improves accident anticipation by shifting from direct collision probability estimation to forecasting future scene dynamics, offering a new predictive paradigm.
FLaRA predicts future latent representations from dashcam videos to anticipate traffic accidents, achieving state-of-the-art performance on the Nexar dataset and cross-domain benchmarks (DAD, DADA-2000, DoTA) with realistic early warnings.
Anticipating traffic accidents from dashcam videos is a critical challenge in intelligent transportation systems. Existing methods typically map visual context directly to a collision probability without explicitly modeling the future evolution of the driving scene. In this paper we propose FLaRA (Predicting Future Latent Representations for Accident Anticipation), a novel predictive architecture that shifts this paradigm by forecasting future latent representations for accident anticipation. Building upon the Video Joint-Embedding Predictive Architecture (V-JEPA2), our model conditions a predictor network on observed context frames to predict the forthcoming latent features of the scene. A classifier then operates on these predicted future representations rather than only on past observations. To ensure these forecasts remain grounded in realistic future dynamics, we introduce a joint training objective that simultaneously optimizes an auxiliary feature-level reconstruction loss and a cross-entropy classification loss. Extensive evaluations on the Nexar dataset, alongside cross-domain validations on the DAD, DADA-2000, and DoTA benchmarks, demonstrate that our approach achieves state-of-the-art performance while maintaining realistic early warning capabilities.