The Data Hydration Gap: A Formal Model of Underinvestment in General-Purpose Data Products Under Decentralized Governance
This addresses the challenge of data reuse inefficiencies in decentralized organizations like data mesh, which is incremental as it builds on existing governance paradigms.
The paper formalizes the problem of underinvestment in general-purpose data products under decentralized governance, showing that the Nash equilibrium generality gap increases with the number of domains and cross-domain analytics value, leading to significant organizational welfare losses and technical debt growth.
When organizations decentralize data product ownership, as in the data mesh paradigm, each domain team optimizes for its immediate analytical needs, underinvesting in the cross-domain generality that enables organization-wide reuse. We formalize this as a simultaneous-move game in which N domains choose quality (q) and generality (g). Generality creates positive externalities but is privately costly. The Nash equilibrium generality gap is increasing in the number of domains and the value of cross-domain analytics. Under plausible parameter configurations, a corner solution obtains in which no reusable silver layer emerges organically, a condition we term the data mesh trap. Technical debt from narrow products grows quadratically in N. An illustrative calibration suggests non-trivial organizational welfare losses under plausible enterprise parameters. We derive within-model conditions under which centralized, federated, and hybrid governance regimes dominate, and we identify the information asymmetries and transaction costs that complicate implementation. The model provides a formal foundation for empirical research on decentralized data governance.