APCLApr 14, 2015

A data-based classification of Slavic languages: Indices of qualitative variation applied to grapheme frequencies

arXiv:1504.03608v16 citations
AI Analysis

This work provides a novel graphical method for linguistic classification, but it is incremental as it builds on existing Ord's graph techniques.

The authors tackled the problem of classifying Slavic languages by applying a modified Ord's graph to grapheme frequencies, revealing linguistically meaningful relations that were not interpretable with the original method.

The Ord's graph is a simple graphical method for displaying frequency distributions of data or theoretical distributions in the two-dimensional plane. Its coordinates are proportions of the first three moments, either empirical or theoretical ones. A modification of the Ord's graph based on proportions of indices of qualitative variation is presented. Such a modification makes the graph applicable also to data of categorical character. In addition, the indices are normalized with values between 0 and 1, which enables comparing data files divided into different numbers of categories. Both the original and the new graph are used to display grapheme frequencies in eleven Slavic languages. As the original Ord's graph requires an assignment of numbers to the categories, graphemes were ordered decreasingly according to their frequencies. Data were taken from parallel corpora, i.e., we work with grapheme frequencies from a Russian novel and its translations to ten other Slavic languages. Then, cluster analysis is applied to the graph coordinates. While the original graph yields results which are not linguistically interpretable, the modification reveals meaningful relations among the languages.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes