Emoji Retrieval from Gibberish or Garbled Social Media Text: A Novel Methodology and A Case Study
This addresses the loss of emojis in noisy text for social media data analysis, though it is incremental as it builds on existing preprocessing challenges.
The paper tackled the problem of emojis being lost in garbled social media text by proposing a reverse-engineering methodology, which retrieved 157,748 emojis from 76,914 Tweets in a dataset of 509,248 Tweets about the Mpox outbreak, improving text readability metrics.
Emojis are widely used across social media platforms but are often lost in noisy or garbled text, posing challenges for data analysis and machine learning. Conventional preprocessing approaches recommend removing such text, risking the loss of emojis and their contextual meaning. This paper proposes a three-step reverse-engineering methodology to retrieve emojis from garbled text in social media posts. The methodology also identifies reasons for the generation of such text during social media data mining. To evaluate its effectiveness, the approach was applied to 509,248 Tweets about the Mpox outbreak, a dataset referenced in about 30 prior works that failed to retrieve emojis from garbled text. Our method retrieved 157,748 emojis from 76,914 Tweets. Improvements in text readability and coherence were demonstrated through metrics such as Flesch Reading Ease, Flesch-Kincaid Grade Level, Coleman-Liau Index, Automated Readability Index, Dale-Chall Readability Score, Text Standard, and Reading Time. Additionally, the frequency of individual emojis and their patterns of usage in these Tweets were analyzed, and the results are presented.