CYAIARLGSep 14, 2020

The Hardware Lottery

arXiv:2009.06489v2275 citations
Originality Synthesis-oriented
AI Analysis

It highlights a systemic problem in computing research where uneven incentives and hardware constraints may obstruct progress for certain ideas, making it incremental in its critique of historical practices.

The essay introduces the concept of the 'hardware lottery' to describe how research ideas succeed based on compatibility with existing hardware and software rather than inherent superiority, using historical examples to show this can delay progress, especially with the rise of domain-specialized hardware.

Hardware, systems and algorithms research communities have historically had different incentive structures and fluctuating motivation to engage with each other explicitly. This historical treatment is odd given that hardware and software have frequently determined which research ideas succeed (and fail). This essay introduces the term hardware lottery to describe when a research idea wins because it is suited to the available software and hardware and not because the idea is superior to alternative research directions. Examples from early computer science history illustrate how hardware lotteries can delay research progress by casting successful ideas as failures. These lessons are particularly salient given the advent of domain specialized hardware which make it increasingly costly to stray off of the beaten path of research ideas. This essay posits that the gains from progress in computing are likely to become even more uneven, with certain research directions moving into the fast-lane while progress on others is further obstructed.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes