Deep Learning Based Motion Planning For Autonomous Vehicle Using Spatiotemporal LSTM Network
This addresses motion planning for autonomous vehicles in complex traffic, but it is incremental as it builds on existing deep learning and LSTM methods.
The paper tackled motion planning for autonomous vehicles by proposing a deep learning model using a spatiotemporal LSTM network, which generated real-time steering control based on sequential image data, and experiments showed it produced robust and accurate results.
Motion Planning, as a fundamental technology of automatic navigation for the autonomous vehicle, is still an open challenging issue in the real-life traffic situation and is mostly applied by the model-based approaches. However, due to the complexity of the traffic situations and the uncertainty of the edge cases, it is hard to devise a general motion planning system for the autonomous vehicle. In this paper, we proposed a motion planning model based on deep learning (named as spatiotemporal LSTM network), which is able to generate a real-time reflection based on spatiotemporal information extraction. To be specific, the model based on spatiotemporal LSTM network has three main structure. Firstly, the Convolutional Long-short Term Memory (Conv-LSTM) is used to extract hidden features through sequential image data. Then, the 3D Convolutional Neural Network(3D-CNN) is applied to extract the spatiotemporal information from the multi-frame feature information. Finally, the fully connected neural networks are used to construct a control model for autonomous vehicle steering angle. The experiments demonstrated that the proposed method can generate a robust and accurate visual motion planning results for the autonomous vehicle.