Russian Natural Language Generation: Creation of a Language Modelling Dataset and Evaluation with Modern Neural Architectures
This work addresses the problem of limited standardized datasets and model evaluations for non-English languages like Russian, which is incremental as it applies existing methods to a new domain.
The authors tackled the lack of resources for Russian natural language generation by creating a novel dataset and evaluating modern neural architectures like variational autoencoders and generative adversarial networks on it, achieving results measured by metrics such as perplexity, grammatical correctness, and lexical diversity.
Generating coherent, grammatically correct, and meaningful text is very challenging, however, it is crucial to many modern NLP systems. So far, research has mostly focused on English language, for other languages both standardized datasets, as well as experiments with state-of-the-art models, are rare. In this work, we i) provide a novel reference dataset for Russian language modeling, ii) experiment with popular modern methods for text generation, namely variational autoencoders, and generative adversarial networks, which we trained on the new dataset. We evaluate the generated text regarding metrics such as perplexity, grammatical correctness and lexical diversity.