A Cross-Validation Study of Turkish Sentiment Analysis Datasets and Tools
This work addresses the limited availability and inconsistent usage of Turkish sentiment analysis datasets, providing a taxonomy and performance analysis to guide future research in this domain-specific area.
The study reviewed 31 research articles from 2012 to 2022, collecting 23 Turkish sentiment analysis datasets and evaluating state-of-the-art tools on them, finding that tool performance varies significantly with text characteristics.
In recent years, sentiment analysis has gained increasing significance, prompting researchers to explore datasets in various languages, including Turkish. However, the limited availability of Turkish datasets has led to their multifaceted usage in different studies, yielding diverse outcomes. To overcome this challenge, a rigorous review was conducted of research articles published between 2012 and 2022. 31 studies were listed, and 23 Turkish datasets obtained from publicly available sources and email requests used in these studies were collected. We labeled these 31 studies using a taxonomy. We provide a map of sentiment analysis datasets according to this taxonomy in Turkish over 10 years. Moreover, we run state-of-the-art sentiment analysis tools on these datasets and analyzed performance across popular Turkish sentiment datasets. We observed that the performance of the sentiment analysis tools significantly depends on the characteristics of the target text. Our study fosters a more nuanced understanding of sentiment analysis in the Turkish language.