GNAISep 4, 2024

Scaling Laws for Economic Productivity: Experimental Evidence in LLM-Assisted Translation

arXiv:2409.02391v28 citationsh-index: 1
Originality Highly original
AI Analysis

This provides evidence that LLM scaling could boost U.S. productivity by at least 6.9% over the next decade, addressing economic impact for policymakers and industries.

The paper investigated how scaling large language models (LLMs) affects economic productivity in translation tasks, finding that a tenfold increase in model compute improved task speed by 12.3%, grades by 0.18 standard deviations, and earnings per minute by 16.1%, with larger gains for lower-skilled workers.

This paper derives "scaling laws"--empirical relationships between the training compute of Large Language Models (LLMs) and their performance--for economic outcomes. In a preregistered online experiment, 300 professional translators completed 1,800 tasks using one of 13 LLMs (or a control). A tenfold increase in model compute improved task completion speed by 12.3%, grades by 0.18 standard deviations, and earnings per minute by 16.1%. Gains were four times larger for lower-skilled workers. These findings suggest continued model scaling could boost U.S. productivity by at least 6.9% over the next decade.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes