Natural Notation for the Domestic Internet of Things
This work addresses the problem of making IoT devices more user-friendly for domestic users through natural language interaction, but it is incremental as it builds on existing concepts of end-user programming.
The study investigated using natural language for IoT device instructions in smart homes by analyzing sticky notes written by people for themselves, others, or a computer agent, focusing on linguistic features and graphical resources to inform design guidance.
This study explores the use of natural language to give instructions that might be interpreted by Internet of Things (IoT) devices in a domestic `smart home' environment. We start from the proposition that reminders can be considered as a type of end-user programming, in which the executed actions might be performed either by an automated agent or by the author of the reminder. We conducted an experiment in which people wrote sticky notes specifying future actions in their home. In different conditions, these notes were addressed to themselves, to others, or to a computer agent.We analyse the linguistic features and strategies that are used to achieve these tasks, including the use of graphical resources as an informal visual language. The findings provide a basis for design guidance related to end-user development for the Internet of Things.