Progressive Bird's Eye View Perception for Safety-Critical Autonomous Driving: A Comprehensive Survey
It addresses safety-critical issues in autonomous driving perception, but is incremental as it synthesizes existing research rather than introducing new methods.
This survey tackles the challenge of ensuring safety and reliability in Bird's-Eye-View perception for autonomous driving in complex real-world scenarios, by providing a comprehensive review of state-of-the-art frameworks, datasets, and identifying key open-world challenges and future directions.
Bird's-Eye-View (BEV) perception has become a foundational paradigm in autonomous driving, enabling unified spatial representations that support robust multi-sensor fusion and multi-agent collaboration. As autonomous vehicles transition from controlled environments to real-world deployment, ensuring the safety and reliability of BEV perception in complex scenarios - such as occlusions, adverse weather, and dynamic traffic - remains a critical challenge. This survey provides the first comprehensive review of BEV perception from a safety-critical perspective, systematically analyzing state-of-the-art frameworks and implementation strategies across three progressive stages: single-modality vehicle-side, multimodal vehicle-side, and multi-agent collaborative perception. Furthermore, we examine public datasets encompassing vehicle-side, roadside, and collaborative settings, evaluating their relevance to safety and robustness. We also identify key open-world challenges - including open-set recognition, large-scale unlabeled data, sensor degradation, and inter-agent communication latency - and outline future research directions, such as integration with end-to-end autonomous driving systems, embodied intelligence, and large language models.