AILGApr 27, 2020

Learning Neural-Symbolic Descriptive Planning Models via Cube-Space Priors: The Voyage Home (to STRIPS)

arXiv:2004.12850v322 citations
AI Analysis

This addresses the challenge of autonomous model learning for planning in AI, though it appears incremental as it builds on existing neuro-symbolic and planning methods.

The paper tackles the problem of enabling agents to learn discrete state transition models from images autonomously, achieving a neuro-symbolic architecture that produces Planning Domain Definition Language (PDDL) models usable by off-the-shelf solvers, allowing it to solve visual 15-Puzzle instances beyond blind search without domain-dependent reward training.

We achieved a new milestone in the difficult task of enabling agents to learn about their environment autonomously. Our neuro-symbolic architecture is trained end-to-end to produce a succinct and effective discrete state transition model from images alone. Our target representation (the Planning Domain Definition Language) is already in a form that off-the-shelf solvers can consume, and opens the door to the rich array of modern heuristic search capabilities. We demonstrate how the sophisticated innate prior we place on the learning process significantly reduces the complexity of the learned representation, and reveals a connection to the graph-theoretic notion of "cube-like graphs", thus opening the door to a deeper understanding of the ideal properties for learned symbolic representations. We show that the powerful domain-independent heuristics allow our system to solve visual 15-Puzzle instances which are beyond the reach of blind search, without resorting to the Reinforcement Learning approach that requires a huge amount of training on the domain-dependent reward information.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes