Exploring Data Pipelines through the Process Lens: a Reference Model forComputer Vision
This work addresses dataset harms for computer vision researchers and practitioners, but it is incremental as it builds on existing analyses by systematizing them through a new lens.
The paper tackles the problem of hazardous outcomes in computer vision datasets by proposing a process-oriented lens to analyze data pipelines, resulting in a preliminary reference model for CV data pipelines.
Researchers have identified datasets used for training computer vision (CV) models as an important source of hazardous outcomes, and continue to examine popular CV datasets to expose their harms. These works tend to treat datasets as objects, or focus on particular steps in data production pipelines. We argue here that we could further systematize our analysis of harms by examining CV data pipelines through a process-oriented lens that captures the creation, the evolution and use of these datasets. As a step towards cultivating a process-oriented lens, we embarked on an empirical study of CV data pipelines informed by the field of method engineering. We present here a preliminary result: a reference model of CV data pipelines. Besides exploring the questions that this endeavor raises, we discuss how the process lens could support researchers in discovering understudied issues, and could help practitioners in making their processes more transparent.