Prompt-to-Product: Generative Assembly via Bimanual Manipulation
This addresses the challenge of automating assembly creation for users with imaginative ideas but limited expertise, though it appears incremental as it builds on existing generative and robotic methods.
The paper tackles the problem of manual effort and expertise required for creating assembly products by introducing Prompt-to-Product, an automated pipeline that generates real-world LEGO brick assemblies from natural language prompts and constructs them with a bimanual robotic system, significantly lowering barriers and reducing manual effort according to user studies.
Creating assembly products demands significant manual effort and expert knowledge in 1) designing the assembly and 2) constructing the product. This paper introduces Prompt-to-Product, an automated pipeline that generates real-world assembly products from natural language prompts. Specifically, we leverage LEGO bricks as the assembly platform and automate the process of creating brick assembly structures. Given the user design requirements, Prompt-to-Product generates physically buildable brick designs, and then leverages a bimanual robotic system to construct the real assembly products, bringing user imaginations into the real world. We conduct a comprehensive user study, and the results demonstrate that Prompt-to-Product significantly lowers the barrier and reduces manual effort in creating assembly products from imaginative ideas.