Why Human Guidance Matters in Collaborative Vibe Coding
This addresses the role of humans in AI-assisted coding for improving productivity and collaboration in software development, though it is incremental in exploring specific guidance mechanisms.
The study tackled the problem of understanding the impact of human guidance in collaborative vibe coding, showing that human-led instructions uniquely maintain performance across iterations, while AI-led ones often cause collapse, with hybrid systems performing best when humans provide instructions and AI handles evaluation.
Writing code has been one of the most transformative ways for human societies to translate abstract ideas into tangible technologies. Modern AI is transforming this process by enabling experts and non-experts alike to generate code without actually writing code, but instead, through natural language instructions, or "vibe coding". While increasingly popular, the cumulative impact of vibe coding on productivity and collaboration, as well as the role of humans in this process, remains unclear. Here, we introduce a controlled experimental framework for studying collaborative vibe coding and use it to compare human-led, AI-led, and hybrid groups. Across 16 experiments involving 604 human participants, we show that people provide uniquely effective high-level instructions for vibe coding across iterations, whereas AI-provided instructions often result in performance collapse. We further demonstrate that hybrid systems perform best when humans retain directional control (providing the instructions), while evaluation is delegated to AI.