Approaches to Semantic Textual Similarity in Slovak Language: From Algorithms to Transformers
This work addresses a gap in NLP for Slovak, an under-resourced language, but is incremental as it applies existing methods without introducing new paradigms.
The paper tackled semantic textual similarity for the under-resourced Slovak language by comparing traditional algorithms, machine learning models, and third-party deep learning tools, finding trade-offs between these approaches.
Semantic textual similarity (STS) plays a crucial role in many natural language processing tasks. While extensively studied in high-resource languages, STS remains challenging for under-resourced languages such as Slovak. This paper presents a comparative evaluation of sentence-level STS methods applied to Slovak, including traditional algorithms, supervised machine learning models, and third-party deep learning tools. We trained several machine learning models using outputs from traditional algorithms as features, with feature selection and hyperparameter tuning jointly guided by artificial bee colony optimization. Finally, we evaluated several third-party tools, including fine-tuned model by CloudNLP, OpenAI's embedding models, GPT-4 model, and pretrained SlovakBERT model. Our findings highlight the trade-offs between different approaches.