Foundations of the Socio-physical Model of Activities (SOMA) for Autonomous Robotic Agents
This work addresses the challenge of enabling autonomous robotic agents to interpret and execute everyday tasks from underspecified natural language commands, which is a foundational problem for human-robot interaction.
This paper introduces the Socio-physical Model of Activities (SOMA), a framework designed to help autonomous robotic agents understand and execute everyday tasks by integrating both physical and social contextual information. SOMA links specific occurrences with their generalized representations, enabling agents to infer unspecified information from natural language commands and reduce the search space for task execution.
In this paper, we present foundations of the Socio-physical Model of Activities (SOMA). SOMA represents both the physical as well as the social context of everyday activities. Such tasks seem to be trivial for humans, however, they pose severe problems for artificial agents. For starters, a natural language command requesting something will leave many pieces of information necessary for performing the task unspecified. Humans can solve such problems fast as we reduce the search space by recourse to prior knowledge such as a connected collection of plans that describe how certain goals can be achieved at various levels of abstraction. Rather than enumerating fine-grained physical contexts SOMA sets out to include socially constructed knowledge about the functions of actions to achieve a variety of goals or the roles objects can play in a given situation. As the human cognition system is capable of generalizing experiences into abstract knowledge pieces applicable to novel situations, we argue that both physical and social context need be modeled to tackle these challenges in a general manner. This is represented by the link between the physical and social context in SOMA where relationships are established between occurrences and generalizations of them, which has been demonstrated in several use cases that validate SOMA.