AILGApr 3, 2024

Goal Recognition Design for General Behavioral Agents using Machine Learning

arXiv:2404.03054v32 citationsh-index: 2Trans. Mach. Learn. Res.
AI Analysis

This work addresses the computational and behavioral limitations in GRD for decision-making environments, offering incremental improvements with broader applicability.

The paper tackles the problem of goal recognition design (GRD) by developing a machine learning-based approach that improves runtime efficiency and handles agents with general behavioral models, outperforming existing methods in reducing worst-case distinctiveness (wcd) and adapting to complex constraints.

Goal recognition design (GRD) aims to make limited modifications to decision-making environments to make it easier to infer the goals of agents acting within those environments. Although various research efforts have been made in goal recognition design, existing approaches are computationally demanding and often assume that agents are (near-)optimal in their decision-making. To address these limitations, we leverage machine learning methods for goal recognition design that can both improve run-time efficiency and account for agents with general behavioral models. Following existing literature, we use worst-case distinctiveness (wcd) as a measure of the difficulty in inferring the goal of an agent in a decision-making environment. Our approach begins by training a machine learning model to predict the wcd for a given environment and the agent behavior model. We then propose a gradient-based optimization framework that accommodates various constraints to optimize decision-making environments for enhanced goal recognition. Through extensive simulations, we demonstrate that our approach outperforms existing methods in reducing wcd and enhances runtime efficiency. Moreover, our approach also adapts to settings in which existing approaches do not apply, such as those involving flexible budget constraints, more complex environments, and suboptimal agent behavior. Finally, we conducted human-subject experiments that demonstrate that our method creates environments that facilitate efficient goal recognition from human decision-makers.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes