Coherent Multi-Agent Trajectory Forecasting in Team Sports with CausalTraj
This addresses the challenge of generating plausible multi-agent scenarios in sports analytics, which is incremental as it builds on existing trajectory forecasting methods by focusing on joint coherence.
The paper tackles the problem of jointly forecasting trajectories of multiple interacting agents in team sports, proposing CausalTraj to generate coherent multi-agent predictions, which achieves competitive per-agent accuracy and state-of-the-art results on joint metrics across NBA SportVU, Basketball-U, and Football-U datasets.
Jointly forecasting trajectories of multiple interacting agents is a core challenge in sports analytics and other domains involving complex group dynamics. Accurate prediction enables realistic simulation and strategic understanding of gameplay evolution. Most existing models are evaluated solely on per-agent accuracy metrics (minADE, minFDE), which assess each agent independently on its best-of-k prediction. However these metrics overlook whether the model learns which predicted trajectories can jointly form a plausible multi-agent future. Many state-of-the-art models are designed and optimized primarily based on these metrics. As a result, they may underperform on joint predictions and also fail to generate coherent, interpretable multi-agent scenarios in team sports. We propose CausalTraj, a temporally causal, likelihood-based model that is built to generate jointly probable multi-agent trajectory forecasts. To better assess collective modeling capability, we emphasize joint metrics (minJADE, minJFDE) that measure joint accuracy across agents within the best generated scenario sample. Evaluated on the NBA SportVU, Basketball-U, and Football-U datasets, CausalTraj achieves competitive per-agent accuracy and the best recorded results on joint metrics, while yielding qualitatively coherent and realistic gameplay evolutions.