LeTS-Drive: Driving in a Crowd by Learning from Tree Search
It addresses the problem of real-time autonomous navigation in dynamic, crowded settings for robotics, representing an incremental improvement over existing methods.
The paper tackles autonomous driving in crowded environments by integrating online POMDP planning with deep learning, resulting in LeTS-Drive, which outperforms planning or imitation learning alone in simulation.
Autonomous driving in a crowded environment, e.g., a busy traffic intersection, is an unsolved challenge for robotics. The robot vehicle must contend with a dynamic and partially observable environment, noisy sensors, and many agents. A principled approach is to formalize it as a Partially Observable Markov Decision Process (POMDP) and solve it through online belief-tree search. To handle a large crowd and achieve real-time performance in this very challenging setting, we propose LeTS-Drive, which integrates online POMDP planning and deep learning. It consists of two phases. In the offline phase, we learn a policy and the corresponding value function by imitating the belief tree search. In the online phase, the learned policy and value function guide the belief tree search. LeTS-Drive leverages the robustness of planning and the runtime efficiency of learning to enhance the performance of both. Experimental results in simulation show that LeTS-Drive outperforms either planning or imitation learning alone and develops sophisticated driving skills.