BrickPal: Augmented Reality-based Assembly Instructions for Brick Models
This addresses the problem of cumbersome and non-interactive assembly instructions for casual users and customized brick sets, representing an incremental improvement in AR-based guidance systems.
The paper tackles the manual effort and lack of interactivity in traditional brick assembly instructions by presenting BrickPal, an augmented reality system that uses NLP to generate assembly sequences and provides real-time guidance, with a user study showing its effectiveness and usability comparable to manual sequences.
The assembly instruction is a mandatory component of Lego-like brick sets.The conventional production of assembly instructions requires a considerable amount of manual fine-tuning, which is intractable for casual users and customized brick sets.Moreover, the traditional paper-based instructions lack expressiveness and interactivity.To tackle the two problems above, we present BrickPal, an augmented reality-based system, which visualizes assembly instructions in an augmented reality head-mounted display. It utilizes Natural Language Processing (NLP) techniques to generate plausible assembly sequences, and provide real-time guidance in the AR headset.Our user study demonstrates BrickPal's effectiveness at assisting users in brick assembly compared to traditional assembly methods. Additionally, the NLP algorithm-generated assembly sequences achieve the same usability with manually adapted sequences.