React to This (RTT): A Nonverbal Turing Test for Embodied AI
This addresses the need for better assessment of embodied AI in human-like interactions, though it appears incremental as it builds on existing Turing test frameworks.
The authors tackled the problem of evaluating embodied AI agents' interaction awareness and believability in challenging scenarios by proposing the React to This (RTT) test for nonverbal behaviors, presenting initial experimental results.
We propose an approach to test embodied AI agents for interaction awareness and believability, particularly in scenarios where humans push them to their limits. Turing introduced the Imitation Game as a way to explore the question: "Can machines think?" The Total Turing Test later expanded this concept beyond purely verbal communication, incorporating perceptual and physical interaction. Building on this, we propose a new guiding question: "Can machines react?" and introduce the React to This (RTT) test for nonverbal behaviors, presenting results from an initial experiment.