Item Type | Journal paper |
Abstract | We present an annotation approach to capturing emotional and cognitive empathy in student-written peer reviews on business models in German. We propose an annotation scheme that allows us to model emotional and cognitive empathy scores based on three types of review components. Also, we conducted an annotation study with three annotators based on 92 student essays to evaluate our annotation scheme. The obtained inter-rater agreement of α = 0.79 for the components and the π = 0.41 for the empathy scores indicate that the proposed annotation scheme successfully guides annotators to a substantial to moderate agreement. Moreover, we trained predictive models to detect the annotated empathy structures and embedded them in an adaptive writing support system for students to receive individual empathy feedback independent of an instructor, time, and location. We evaluated our tool in a peer learning exercise with 58 students and found promising results for perceived empathy skill learning, perceived feedback accuracy, and intention to use. Finally, we present our freely available corpus of 500 empathy-annotated, student-written peer reviews on business models and our annotation guidelines to encourage future research on the design and development of empathy support systems. |
Authors | Wambsganss, Thiemo; Niklaus, Christina; Söllner, Matthias; Handschuh, Siegfried & Leimeister, Jan Marco |
Journal or Publication Title | The Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (ACL-IJCNLP 2021) |
Language | English |
Subjects | computer science information management education |
HSG Classification | contribution to scientific community |
HSG Profile Area | SoM - Business Innovation |
Refereed | Yes |
Date | August 2021 |
Depositing User | Thiemo Wambsganss |
Date Deposited | 08 Jun 2021 09:29 |
Last Modified | 20 Jul 2022 17:45 |
URI: | https://www.alexandria.unisg.ch/publications/263282 |
Download
CitationWambsganss, Thiemo; Niklaus, Christina; Söllner, Matthias; Handschuh, Siegfried & Leimeister, Jan Marco (2021) Supporting Cognitive and Emotional Empathic Writing of Students. The Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (ACL-IJCNLP 2021), Statisticshttps://www.alexandria.unisg.ch/id/eprint/263282
|