Fast and Real-time End to End Control in Autonomous Racing Cars Through Representation Learning
This addresses the need for faster and longer-horizon control algorithms in autonomous racing, which is a domain-specific challenge distinct from regular autonomous driving.
The paper tackles the problem of autonomous racing by developing an end-to-end method that uses video input to control steering and throttle, achieving real-time performance with a novel unsupervised trajectory planner integrated into a learning-based framework, demonstrated in the CARLA simulator.
The challenges presented in an autonomous racing situation are distinct from those faced in regular autonomous driving and require faster end-to-end algorithms and consideration of a longer horizon in determining optimal current actions keeping in mind upcoming maneuvers and situations. In this paper, we propose an end-to-end method for autonomous racing that takes in as inputs video information from an onboard camera and determines final steering and throttle control actions. We use the following split to construct such a method (1) learning a low dimensional representation of the scene, (2) pre-generating the optimal trajectory for the given scene, and (3) tracking the predicted trajectory using a classical control method. In learning a low-dimensional representation of the scene, we use intermediate representations with a novel unsupervised trajectory planner to generate expert trajectories, and hence utilize them to directly predict race lines from a given front-facing input image. Thus, the proposed algorithm employs the best of two worlds - the robustness of learning-based approaches to perception and the accuracy of optimization-based approaches for trajectory generation in an end-to-end learning-based framework. We deploy and demonstrate our framework on CARLA, a photorealistic simulator for testing self-driving cars in realistic environments.