CLITNESep 13, 2021

The Emergence of the Shape Bias Results from Communicative Efficiency

arXiv:2109.06232v2664 citations
AI Analysis

This addresses a foundational problem in cognitive science and language acquisition for understanding how biases like shape preference arise in human learning.

The paper tackles the chicken-and-egg problem of how the shape bias emerges in language by proposing that communicative efficiency drives its emergence and persistence across generations, using neural emergent language agents to show that efficient communication strategies lead to the shape bias and that communicative pressure is necessary for its persistence.

By the age of two, children tend to assume that new word categories are based on objects' shape, rather than their color or texture; this assumption is called the shape bias. They are thought to learn this bias by observing that their caregiver's language is biased towards shape based categories. This presents a chicken and egg problem: if the shape bias must be present in the language in order for children to learn it, how did it arise in language in the first place? In this paper, we propose that communicative efficiency explains both how the shape bias emerged and why it persists across generations. We model this process with neural emergent language agents that learn to communicate about raw pixelated images. First, we show that the shape bias emerges as a result of efficient communication strategies employed by agents. Second, we show that pressure brought on by communicative need is also necessary for it to persist across generations; simply having a shape bias in an agent's input language is insufficient. These results suggest that, over and above the operation of other learning strategies, the shape bias in human learners may emerge and be sustained by communicative pressures.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes