RealitySketch: Embedding Responsive Graphics and Visualizations in AR through Dynamic Sketching
This addresses the limitation of non-responsive AR sketches for users in fields like education and training, though it is incremental as it builds on existing AR sketching tools.
The paper tackles the problem of static sketches in augmented reality by introducing RealitySketch, an AR interface that allows users to create dynamic graphics that respond to real-world motion, enabling applications like physics education and sports training with real-time visualization.
We present RealitySketch, an augmented reality interface for sketching interactive graphics and visualizations. In recent years, an increasing number of AR sketching tools enable users to draw and embed sketches in the real world. However, with the current tools, sketched contents are inherently static, floating in mid air without responding to the real world. This paper introduces a new way to embed dynamic and responsive graphics in the real world. In RealitySketch, the user draws graphical elements on a mobile AR screen and binds them with physical objects in real-time and improvisational ways, so that the sketched elements dynamically move with the corresponding physical motion. The user can also quickly visualize and analyze real-world phenomena through responsive graph plots or interactive visualizations. This paper contributes to a set of interaction techniques that enable capturing, parameterizing, and visualizing real-world motion without pre-defined programs and configurations. Finally, we demonstrate our tool with several application scenarios, including physics education, sports training, and in-situ tangible interfaces.