Vectoring Languages
This work addresses the gap between linguistic theories and LLM advancements, offering a foundational perspective that could accelerate scientific improvements in language understanding.
The authors proposed a novel language structure inspired by linear algebra that better captures language diversity and reflects LLM mechanisms, contrasting it with current LLM design philosophies to suggest new research directions.
Recent breakthroughs in large language models (LLM) have stirred up global attention, and the research has been accelerating non-stop since then. Philosophers and psychologists have also been researching the structure of language for decades, but they are having a hard time finding a theory that directly benefits from the breakthroughs of LLMs. In this article, we propose a novel structure of language that reflects well on the mechanisms behind language models and go on to show that this structure is also better at capturing the diverse nature of language compared to previous methods. An analogy of linear algebra is adapted to strengthen the basis of this perspective. We further argue about the difference between this perspective and the design philosophy for current language models. Lastly, we discuss how this perspective can lead us to research directions that may accelerate the improvements of science fastest.