CLSOC-PHNov 14, 2016

Quantitative Entropy Study of Language Complexity

arXiv:1611.04841v2
AI Analysis

This work provides a text analysis method for comparing language complexity and individual styles, but it is incremental as it applies existing entropy concepts to new linguistic data.

The study measured the entropy of Chinese and English texts, finding significant differences between languages and personal debating styles, with lower entropy indicating higher complexity.

We study the entropy of Chinese and English texts, based on characters in case of Chinese texts and based on words for both languages. Significant differences are found between the languages and between different personal styles of debating partners. The entropy analysis points in the direction of lower entropy, that is of higher complexity. Such a text analysis would be applied for individuals of different styles, a single individual at different age, as well as different groups of the population.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes