CVROJun 23, 2020

Probabilistic Crowd GAN: Multimodal Pedestrian Trajectory Prediction using a Graph Vehicle-Pedestrian Attention Network

arXiv:2006.12906v289 citations
AI Analysis

This work addresses a key challenge for autonomous vehicles and robots in navigating dynamic environments, but it appears incremental as it builds on existing methods like RNNs and GANs with novel modules.

The paper tackles the problem of predicting pedestrian trajectories in crowds, which is crucial for autonomous vehicles, by modeling uncertainty and multimodality in motion and interactions, including vehicle responses. It demonstrates improved state-of-the-art trajectory prediction on various datasets, though specific numerical gains are not detailed in the abstract.

Understanding and predicting the intention of pedestrians is essential to enable autonomous vehicles and mobile robots to navigate crowds. This problem becomes increasingly complex when we consider the uncertainty and multimodality of pedestrian motion, as well as the implicit interactions between members of a crowd, including any response to a vehicle. Our approach, Probabilistic Crowd GAN, extends recent work in trajectory prediction, combining Recurrent Neural Networks (RNNs) with Mixture Density Networks (MDNs) to output probabilistic multimodal predictions, from which likely modal paths are found and used for adversarial training. We also propose the use of Graph Vehicle-Pedestrian Attention Network (GVAT), which models social interactions and allows input of a shared vehicle feature, showing that inclusion of this module leads to improved trajectory prediction both with and without the presence of a vehicle. Through evaluation on various datasets, we demonstrate improvements on the existing state of the art methods for trajectory prediction and illustrate how the true multimodal and uncertain nature of crowd interactions can be directly modelled.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes