Jane L. E

Ritik Batra, Lydia Kim, Ilan Mandel et al.

Craft practices rely on evolving archives of skill and knowledge developed through generations of craftspeople experimenting with designs, materials, and techniques. Better documentation of these practices enables the sharing of knowledge and expertise between sites and generations. However, most documentation focuses on the linear steps leading to final artifacts, neglecting the distinct tacit knowledge, improvisational actions, and situated adaptations needed to meet the unique demands of each craft project. This omission limits knowledge sharing and reduces craft to a mechanical endeavor, rather than a sophisticated and contextual way of seeing, thinking, and doing. Drawing on expert interviews and literature from HCI, CSCW and the social sciences, we develop an elementary grammar to document improvisational actions of real-world craft practices. We demonstrate the utility of this grammar with a MLLM-powered interface called CraftLink that can be used to analyze expert videos and generate documentation to share material and contextual variations of practices with other knowledgeable but non-master craftspeople. Our user study with expert crocheters (N=7) evaluates our grammar's effectiveness in capturing and sharing expert knowledge with other craftspeople, offering new pathways for computational systems to support collaborative archives of knowledge and practice across time, space, and skill levels. We conclude by showing how our grammar address four key tensions of the craft learning environment: personal and shareable documentation, fragmented and discoverable expertise, linear and iterative practices, and data privacy and ownership.

Niels Joubert, Jane L. E, Dan B Goldman et al.

We present a system to capture video footage of human subjects in the real world. Our system leverages a quadrotor camera to automatically capture well-composed video of two subjects. Subjects are tracked in a large-scale outdoor environment using RTK GPS and IMU sensors. Then, given the tracked state of our subjects, our system automatically computes static shots based on well-established visual composition principles and canonical shots from cinematography literature. To transition between these static shots, we calculate feasible, safe, and visually pleasing transitions using a novel real-time trajectory planning algorithm. We evaluate the performance of our tracking system, and experimentally show that RTK GPS significantly outperforms conventional GPS in capturing a variety of canonical shots. Lastly, we demonstrate our system guiding a consumer quadrotor camera autonomously capturing footage of two subjects in a variety of use cases. This is the first end-to-end system that enables people to leverage the mobility of quadrotors, as well as the knowledge of expert filmmakers, to autonomously capture high-quality footage of people in the real world.