MIRIAM: A Multimodal Chat-Based Interface for Autonomous Systems
This addresses the need for improved human-machine interaction in autonomous systems, but it appears incremental as it builds on existing command and control interfaces without claiming major breakthroughs.
The authors tackled the problem of enhancing situation awareness in autonomous vehicles by introducing MIRIAM, a multimodal chat-based interface that allows users to interact about plans and objectives, with the system proactively sending messages for key events like fault warnings.
We present MIRIAM (Multimodal Intelligent inteRactIon for Autonomous systeMs), a multimodal interface to support situation awareness of autonomous vehicles through chat-based interaction. The user is able to chat about the vehicle's plan, objectives, previous activities and mission progress. The system is mixed initiative in that it pro-actively sends messages about key events, such as fault warnings. We will demonstrate MIRIAM using SeeByte's SeeTrack command and control interface and Neptune autonomy simulator.