AI Assisted AR Assembly: Object Recognition and Computer Vision for Augmented Reality Assisted Assembly
This addresses inefficiencies in assembly workflows for users like technicians or hobbyists, but it is incremental as it applies existing object recognition methods to a specific AR application.
The paper tackles the problem of manual component handling in assembly tasks by developing an AI-assisted AR system that uses deep learning-based object recognition to identify components and display step-by-step instructions, eliminating the need for manual searching and sorting, as demonstrated in a case study with LEGO sculptures.
We present an AI-assisted Augmented Reality assembly workflow that uses deep learning-based object recognition to identify different assembly components and display step-by-step instructions. For each assembly step, the system displays a bounding box around the corresponding components in the physical space, and where the component should be placed. By connecting assembly instructions with the real-time location of relevant components, the system eliminates the need for manual searching, sorting, or labeling of different components before each assembly. To demonstrate the feasibility of using object recognition for AR-assisted assembly, we highlight a case study involving the assembly of LEGO sculptures.