The Sentiment Problem: A Critical Survey towards Deconstructing Sentiment Analysis
This work addresses the problem of inconsistent definitions and biases in sentiment analysis for researchers and practitioners, though it is incremental as it builds on existing critiques.
The paper critically surveys 189 peer-reviewed papers to examine the sociotechnical aspects of sentiment analysis, revealing a lack of explicit definitions and frameworks that lead to potential challenges and biases, and proposes an ethics sheet to guide practitioners for equitable use.
We conduct an inquiry into the sociotechnical aspects of sentiment analysis (SA) by critically examining 189 peer-reviewed papers on their applications, models, and datasets. Our investigation stems from the recognition that SA has become an integral component of diverse sociotechnical systems, exerting influence on both social and technical users. By delving into sociological and technological literature on sentiment, we unveil distinct conceptualizations of this term in domains such as finance, government, and medicine. Our study exposes a lack of explicit definitions and frameworks for characterizing sentiment, resulting in potential challenges and biases. To tackle this issue, we propose an ethics sheet encompassing critical inquiries to guide practitioners in ensuring equitable utilization of SA. Our findings underscore the significance of adopting an interdisciplinary approach to defining sentiment in SA and offer a pragmatic solution for its implementation.