Self-Organizing Language
This work addresses fundamental questions about the existence and origin of all human language data, potentially bridging neuro-symbolic approaches.
The paper tackles the problem of understanding the origin and structure of human language by introducing a novel paradigm of emergent local memory, which produces human language without data through self-organizing dynamics, showing that words arise as a side-effect of emergent symbolic order.
We introduce a novel paradigm of emergent local memory. It is a continuous-learning completely-parallel content-addressable memory encoding global order. It demonstrates how local constraints on uncoordinated learning can produce topologically protected memories realizing emergent symbolic order. It is therefore a neuro-symbolic bridge. It further has the ability to produce human language without data, by exploiting its own self-organizing dynamics. It teaches us that words arise as a side-effect of emergent symbolic order, and that human language patterns at all structural levels reflect a universal mechanism of word formation (which is subregular). This work answers essential questions about the existence \& origin of all the human language data.