CLDec 23, 2021

TFW2V: An Enhanced Document Similarity Method for the Morphologically Rich Finnish Language

arXiv:2112.12489v1580 citations
Originality Synthesis-oriented
AI Analysis

This work addresses document similarity for Finnish language applications in Digital Humanities, but it appears incremental as it builds on existing approaches with a simple method.

The authors tackled the challenge of measuring semantic similarity for the morphologically rich Finnish language, proposing TFW2V, which achieved high efficiency in handling long texts and limited data, though no specific performance numbers were provided.

Measuring the semantic similarity of different texts has many important applications in Digital Humanities research such as information retrieval, document clustering and text summarization. The performance of different methods depends on the length of the text, the domain and the language. This study focuses on experimenting with some of the current approaches to Finnish, which is a morphologically rich language. At the same time, we propose a simple method, TFW2V, which shows high efficiency in handling both long text documents and limited amounts of data. Furthermore, we design an objective evaluation method which can be used as a framework for benchmarking text similarity approaches.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes