Inter-Rater Agreement Study on Readability Assessment in Bengali
This addresses the need for reliable readability assessment tools in Bengali, but it is incremental as it focuses on dataset creation and agreement analysis without introducing new methods.
The study tackled the problem of assessing readability in Bengali by conducting an inter-rater agreement analysis, resulting in moderate to fair agreement among seven annotators on 30 text passages and producing an annotated dataset.
An inter-rater agreement study is performed for readability assessment in Bengali. A 1-7 rating scale was used to indicate different levels of readability. We obtained moderate to fair agreement among seven independent annotators on 30 text passages written by four eminent Bengali authors. As a by product of our study, we obtained a readability-annotated ground truth dataset in Bengali. .