CrossTalk: Intelligent Substrates for Language-Oriented Interaction in Video-Based Communication and Collaboration
This addresses the need for more proactive and intelligent communication tools for users of videoconferencing and virtual reality, though it appears incremental as it builds on existing media with added design concepts.
The paper tackled the problem of digital communication media being oblivious to user intentions by proposing CrossTalk, a videoconferencing system that integrates intelligence to enhance communication and collaboration, resulting in a more fluid and flexible experience.
Despite the advances and ubiquity of digital communication media such as videoconferencing and virtual reality, they remain oblivious to the rich intentions expressed by users. Beyond transmitting audio, videos, and messages, we envision digital communication media as proactive facilitators that can provide unobtrusive assistance to enhance communication and collaboration. Informed by the results of a formative study, we propose three key design concepts to explore the systematic integration of intelligence into communication and collaboration, including the panel substrate, language-based intent recognition, and lightweight interaction techniques. We developed CrossTalk, a videoconferencing system that instantiates these concepts, which was found to enable a more fluid and flexible communication and collaboration experience.