Supporting Cognitive and Emotional Empathic Writing of Students
This work addresses the problem of enhancing empathy skills in student writing for educational contexts, though it is incremental as it builds on existing annotation and feedback methods.
The researchers tackled the challenge of assessing and supporting empathy in student writing by developing an annotation scheme for emotional and cognitive empathy in peer reviews, achieving inter-rater agreements of α=0.79 and multi-π=0.41, and integrating predictive models into a writing support tool that showed promising results in a study with 58 students.
We present an annotation approach to capturing emotional and cognitive empathy in student-written peer reviews on business models in German. We propose an annotation scheme that allows us to model emotional and cognitive empathy scores based on three types of review components. Also, we conducted an annotation study with three annotators based on 92 student essays to evaluate our annotation scheme. The obtained inter-rater agreement of α=0.79 for the components and the multi-π=0.41 for the empathy scores indicate that the proposed annotation scheme successfully guides annotators to a substantial to moderate agreement. Moreover, we trained predictive models to detect the annotated empathy structures and embedded them in an adaptive writing support system for students to receive individual empathy feedback independent of an instructor, time, and location. We evaluated our tool in a peer learning exercise with 58 students and found promising results for perceived empathy skill learning, perceived feedback accuracy, and intention to use. Finally, we present our freely available corpus of 500 empathy-annotated, student-written peer reviews on business models and our annotation guidelines to encourage future research on the design and development of empathy support systems.