Performance/power assessment of CNN packages on embedded automotive platforms
This work addresses the challenge for automotive engineers in selecting optimal CNN packages and computing systems for autonomous driving applications, though it is incremental as it benchmarks existing methods on new hardware.
The paper assesses the performance and power efficiency of recent CNN packages on embedded automotive platforms to help engineers meet autonomous driving accuracy and performance targets within power and size constraints, providing concrete FPS and mAP comparisons across platforms like NVIDIA Xavier AGX and Xilinx Zynq UltraScale+.
The rise of power-efficient embedded computers based on highly-parallel accelerators opens a number of opportunities and challenges for researchers and engineers, and paved the way to the era of edge computing. At the same time, advances in embedded AI for object detection and categorization such as YOLO, GoogleNet and AlexNet reached an unprecedented level of accuracy (mean-Average Precision - mAP) and performance (Frames-Per-Second - FPS). Today, edge computers based on heterogeneous many-core systems are a predominant choice to deploy such systems in industry 4.0, wearable devices, and - our focus - autonomous driving systems. In these latter systems, engineers struggle to make reduced automotive power and size budgets co-exist with the accuracy and performance targets requested by autonomous driving. We aim at validating the effectiveness and efficiency of most recent networks on state-of-the-art platforms with embedded commercial-off-the-shelf System-on-Chips, such as Xavier AGX, Tegra X2 and Nano for NVIDIA and XCZU9EG and XCZU3EG of the Zynq UltraScale+ family, for the Xilinx counterpart. Our work aims at supporting engineers in choosing the most appropriate CNN package and computing system for their designs, and deriving guidelines for adequately sizing their systems.