3Description: An Intuitive Human-AI Collaborative 3D Modeling Approach
This work addresses accessibility challenges in 3D modeling for non-professional individuals, though it appears incremental as it integrates existing AI technologies into a new application.
The paper tackles the problem of accessibility and usability in 3D modeling for non-professionals by introducing 3Description, a human-AI collaborative approach that allows users to create and adjust 3D models using verbal and gesture descriptions, resulting in a more inclusive and user-friendly design process.
This paper presents 3Description, an experimental human-AI collaborative approach for intuitive 3D modeling. 3Description aims to address accessibility and usability challenges in traditional 3D modeling by enabling non-professional individuals to co-create 3D models using verbal and gesture descriptions. Through a combination of qualitative research, product analysis, and user testing, 3Description integrates AI technologies such as Natural Language Processing and Computer Vision, powered by OpenAI and MediaPipe. Recognizing the web has wide cross-platform capabilities, 3Description is web-based, allowing users to describe the desired model and subsequently adjust its components using verbal and gestural inputs. In the era of AI and emerging media, 3Description not only contributes to a more inclusive and user-friendly design process, empowering more people to participate in the construction of the future 3D world, but also strives to increase human engagement in co-creation with AI, thereby avoiding undue surrender to technology and preserving human creativity.