Eduard Yu. Lerner

1paper

1 Paper

CLDec 29, 2016
Verifying Heaps' law using Google Books Ngram data

Vladimir V. Bochkarev, Eduard Yu. Lerner, Anna V. Shevlyakova

This article is devoted to the verification of the empirical Heaps law in European languages using Google Books Ngram corpus data. The connection between word distribution frequency and expected dependence of individual word number on text size is analysed in terms of a simple probability model of text generation. It is shown that the Heaps exponent varies significantly within characteristic time intervals of 60-100 years.