GraphAD: Interaction Scene Graph for End-to-end Autonomous Driving
This addresses safety-critical interaction modeling for autonomous driving systems, representing an incremental improvement over existing attention-based methods.
The paper tackles the problem of modeling complex interactions in autonomous driving by proposing an Interaction Scene Graph (ISG) to unify interactions among ego-vehicle, road agents, and map elements, resulting in significantly better performance on full-stack driving tasks compared to strong baselines on the nuScenes dataset.
Modeling complicated interactions among the ego-vehicle, road agents, and map elements has been a crucial part for safety-critical autonomous driving. Previous works on end-to-end autonomous driving rely on the attention mechanism for handling heterogeneous interactions, which fails to capture the geometric priors and is also computationally intensive. In this paper, we propose the Interaction Scene Graph (ISG) as a unified method to model the interactions among the ego-vehicle, road agents, and map elements. With the representation of the ISG, the driving agents aggregate essential information from the most influential elements, including the road agents with potential collisions and the map elements to follow. Since a mass of unnecessary interactions are omitted, the more efficient scene-graph-based framework is able to focus on indispensable connections and leads to better performance. We evaluate the proposed method for end-to-end autonomous driving on the nuScenes dataset. Compared with strong baselines, our method significantly outperforms in the full-stack driving tasks, including perception, prediction, and planning. Code will be released at https://github.com/zhangyp15/GraphAD.