LGCYOct 6, 2021

Machine Learning Practices Outside Big Tech: How Resource Constraints Challenge Responsible Development

arXiv:2110.02932v152 citations
Originality Synthesis-oriented
AI Analysis

It addresses the gap in research on ML practitioners in resource-limited settings like startups and public sectors, which is incremental but important for broadening responsible ML development.

The paper tackles the problem of understanding machine learning practices in organizations outside Big Tech and academia, revealing through 17 interviews that resource constraints introduce tensions such as between privacy and ubiquity, impacting responsible development.

Practitioners from diverse occupations and backgrounds are increasingly using machine learning (ML) methods. Nonetheless, studies on ML Practitioners typically draw populations from Big Tech and academia, as researchers have easier access to these communities. Through this selection bias, past research often excludes the broader, lesser-resourced ML community -- for example, practitioners working at startups, at non-tech companies, and in the public sector. These practitioners share many of the same ML development difficulties and ethical conundrums as their Big Tech counterparts; however, their experiences are subject to additional under-studied challenges stemming from deploying ML with limited resources, increased existential risk, and absent access to in-house research teams. We contribute a qualitative analysis of 17 interviews with stakeholders from organizations which are less represented in prior studies. We uncover a number of tensions which are introduced or exacerbated by these organizations' resource constraints -- tensions between privacy and ubiquity, resource management and performance optimization, and access and monopolization. Increased academic focus on these practitioners can facilitate a more holistic understanding of ML limitations, and so is useful for prescribing a research agenda to facilitate responsible ML development for all.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes