NU HLT at CMCL 2022 Shared Task: Multilingual and Crosslingual Prediction of Human Reading Behavior in Universal Language Space
This addresses the problem of predicting reading behavior across languages for psycholinguistics and NLP, but it is incremental as it applies existing methods to a new preprocessing approach.
The paper tackled multilingual and crosslingual prediction of human reading times by transforming words to International Phonetic Alphabet (IPA) representations, achieving MAE scores of 3.8031 for FFDAvg and 3.9065 for TRTAvg with a Random Forest model.
In this paper, we present a unified model that works for both multilingual and crosslingual prediction of reading times of words in various languages. The secret behind the success of this model is in the preprocessing step where all words are transformed to their universal language representation via the International Phonetic Alphabet (IPA). To the best of our knowledge, this is the first study to favorable exploit this phonological property of language for the two tasks. Various feature types were extracted covering basic frequencies, n-grams, information theoretic, and psycholinguistically-motivated predictors for model training. A finetuned Random Forest model obtained best performance for both tasks with 3.8031 and 3.9065 MAE scores for mean first fixation duration (FFDAvg) and mean total reading time (TRTAvg) respectively.