Experiential Robot Learning with Accelerated Neuroevolution
This work addresses a specific challenge in robotics by offering an alternative to gradient-based methods, though it appears incremental as it builds on existing neuroevolution approaches.
The paper tackled the problem of training neural networks for robotic tasks without requiring differentiability by introducing the Accelerated Neuroevolution algorithm, which successfully enabled agents to complete simulated and physical tasks like Flappy Bird and Object Centering with relatively low generations.
Derivative-based optimization techniques such as Stochastic Gradient Descent has been wildly successful in training deep neural networks. However, it has constraints such as end-to-end network differentiability. As an alternative, we present the Accelerated Neuroevolution algorithm. The new algorithm is aimed towards physical robotic learning tasks following the Experiential Robot Learning method. We test our algorithm first on a simulated task of playing the game Flappy Bird, then on a physical NAO robot in a static Object Centering task. The agents successfully navigate the given tasks, in a relatively low number of generations. Based on our results, we propose to use the algorithm in more complex tasks.