More Is Different: Toward a Theory of Emergence in AI-Native Software Ecosystems
This addresses a fundamental challenge in software engineering for AI-native ecosystems, potentially requiring a radical shift in governance if confirmed, but it is theoretical and incremental in nature.
The paper tackles the problem of multi-agent AI systems failing in unpredictable ways due to interactions, despite individual agents performing correctly, and proposes studying them as complex adaptive systems with a framework to measure causal emergence and seven falsifiable propositions.
Software engineering faces a fundamental challenge: multi-agent AI systems fail in ways that defy explanation by traditional theories. While individual agents perform correctly, their interactions degrade entire ecosystems, revealing a gap in our understanding of software evolution. This paper argues that AI-native software ecosystems must be studied as complex adaptive systems (CAS), where emergent properties like architectural entropy, cascade failures, and comprehension debt arise not from individual components, but from their interactions. We map Holland's six CAS properties onto observable ecosystem dynamics, distinguishing these systems from microservices or open-source networks. To measure causal emergence, we define micro-level state variables, coarse-graining functions, and a tractable measurement framework. Seven falsifiable propositions link CAS theory to software evolution, challenging or extending Lehman's laws where agent-level assumptions fail. If confirmed, these findings would demand a radical shift: ecosystem-level monitoring as the primary governance mechanism for AI-native systems. If refuted, existing theories may only need incremental updates. Either way, this work forces us to ask: Can software engineering's core assumptions survive the age of autonomous agents?