CLMay 14, 2019
On the number of k-skip-n-gramsDmytro Krasnoshtan
The paper proves that the number of k-skip-n-grams for a corpus of size $L$ is $$\frac{Ln + n + k' - n^2 - nk'}{n} \cdot \binom{n-1+k'}{n-1}$$ where $k' = \min(L - n + 1, k)$.
Dmytro Krasnoshtan
1paper