LGDec 12, 2017

Deep Reinforcement Learning Boosted by External Knowledge

arXiv:1712.04101v116 citations
Originality Incremental advance
AI Analysis

This addresses the challenge of time-consuming learning episodes in 3D domains for reinforcement learning applications, though it appears incremental as it builds on existing methods.

The paper tackled the problem of slow learning in complex 3D environments by combining external knowledge with deep reinforcement learning using visual input, resulting in higher performance and faster learning compared to a single model in a 3D partially-observable environment.

Recent improvements in deep reinforcement learning have allowed to solve problems in many 2D domains such as Atari games. However, in complex 3D environments, numerous learning episodes are required which may be too time consuming or even impossible especially in real-world scenarios. We present a new architecture to combine external knowledge and deep reinforcement learning using only visual input. A key concept of our system is augmenting image input by adding environment feature information and combining two sources of decision. We evaluate the performances of our method in a 3D partially-observable environment from the Microsoft Malmo platform. Experimental evaluation exhibits higher performance and faster learning compared to a single reinforcement learning model.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes