Wisdom for the Crowd: Discoursive Power in Annotation Instructions for Computer Vision
It highlights a social problem for Global South annotation workers, revealing how labor practices in AI data annotation reinforce inequalities, making it an incremental study on existing issues.
This paper examines the experiences of Argentinian and Venezuelan annotation workers in computer vision, finding that task instructions reflect imposed worldviews and for-profit goals, perpetuating power asymmetries and social inequalities in datasets and systems.
Developers of computer vision algorithms outsource some of the labor involved in annotating training data through business process outsourcing companies and crowdsourcing platforms. Many data annotators are situated in the Global South and are considered independent contractors. This paper focuses on the experiences of Argentinian and Venezuelan annotation workers. Through qualitative methods, we explore the discourses encoded in the task instructions that these workers follow to annotate computer vision datasets. Our preliminary findings indicate that annotation instructions reflect worldviews imposed on workers and, through their labor, on datasets. Moreover, we observe that for-profit goals drive task instructions and that managers and algorithms make sure annotations are done according to requesters' commands. This configuration presents a form of commodified labor that perpetuates power asymmetries while reinforcing social inequalities and is compelled to reproduce them into datasets and, subsequently, in computer vision systems.