An information-theoretic on-line update principle for perception-action coupling
This work addresses the challenge of efficient perception-action integration in robotics, offering a novel online method that could enhance robotic performance in tasks requiring real-time adaptation, though it appears incremental relative to prior theoretical frameworks.
The paper tackles the problem of optimizing perception-action coupling in robotic systems under limited information-processing capacity, proposing an online optimization procedure that yields optimal perceptual and action channels, demonstrated in a NAO robot simulator for a cup lifting task.
Inspired by findings of sensorimotor coupling in humans and animals, there has recently been a growing interest in the interaction between action and perception in robotic systems [Bogh et al., 2016]. Here we consider perception and action as two serial information channels with limited information-processing capacity. We follow [Genewein et al., 2015] and formulate a constrained optimization problem that maximizes utility under limited information-processing capacity in the two channels. As a solution we obtain an optimal perceptual channel and an optimal action channel that are coupled such that perceptual information is optimized with respect to downstream processing in the action module. The main novelty of this study is that we propose an online optimization procedure to find bounded-optimal perception and action channels in parameterized serial perception-action systems. In particular, we implement the perceptual channel as a multi-layer neural network and the action channel as a multinomial distribution. We illustrate our method in a NAO robot simulator with a simplified cup lifting task.