LGJan 6, 2021

Geometric Entropic Exploration

arXiv:2101.02055v238 citations
Originality Incremental advance
AI Analysis

This work provides a novel method for more effective exploration in Reinforcement Learning, particularly for tasks with sparse rewards, which is a common challenge for RL practitioners.

This paper tackles the problem of exploration in Reinforcement Learning by introducing Geometric Entropy Maximisation (GEM), an algorithm that maximizes the geometry-aware Shannon entropy of state-visits in both discrete and continuous domains. It casts geometry-aware Maximum State-Visitation Entropy (MSVE) exploration as a tractable problem of optimizing a simple and novel noise-contrastive objective function, showing efficiency in solving several RL problems with sparse rewards.

Exploration is essential for solving complex Reinforcement Learning (RL) tasks. Maximum State-Visitation Entropy (MSVE) formulates the exploration problem as a well-defined policy optimization problem whose solution aims at visiting all states as uniformly as possible. This is in contrast to standard uncertainty-based approaches where exploration is transient and eventually vanishes. However, existing approaches to MSVE are theoretically justified only for discrete state-spaces as they are oblivious to the geometry of continuous domains. We address this challenge by introducing Geometric Entropy Maximisation (GEM), a new algorithm that maximises the geometry-aware Shannon entropy of state-visits in both discrete and continuous domains. Our key theoretical contribution is casting geometry-aware MSVE exploration as a tractable problem of optimising a simple and novel noise-contrastive objective function. In our experiments, we show the efficiency of GEM in solving several RL problems with sparse rewards, compared against other deep RL exploration approaches.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes