Learning to Navigate by Growing Deep Networks
This addresses the challenge of adaptability in robot navigation for robotics, though it is incremental as it builds on existing deep learning and reinforcement learning methods.
The paper tackles the problem of enabling robots to learn navigation autonomously without prior environmental knowledge by developing a self-supervised framework that incrementally builds deep network structures as new data arrives, resulting in RA-DAE outperforming non-adaptive alternatives in simulation and real-world tests.
Adaptability is central to autonomy. Intuitively, for high-dimensional learning problems such as navigating based on vision, internal models with higher complexity allow to accurately encode the information available. However, most learning methods rely on models with a fixed structure and complexity. In this paper, we present a self-supervised framework for robots to learn to navigate, without any prior knowledge of the environment, by incrementally building the structure of a deep network as new data becomes available. Our framework captures images from a monocular camera and self labels the images to continuously train and predict actions from a computationally efficient adaptive deep architecture based on Autoencoders (AE), in a self-supervised fashion. The deep architecture, named Reinforced Adaptive Denoising Autoencoders (RA-DAE), uses reinforcement learning to dynamically change the network structure by adding or removing neurons. Experiments were conducted in simulation and real-world indoor and outdoor environments to assess the potential of self-supervised navigation. RA-DAE demonstrates better performance than equivalent non-adaptive deep learning alternatives and can continue to expand its knowledge, trading-off past and present information.