Repository logo
  • English
  • Deutsch
Log In
or
  1. Home
  2. HSG CRIS
  3. HSG Publications
  4. Exploring the Usefulness of Open and Proprietary LLMs in Argumentative Writing Support
 
  • Details

Exploring the Usefulness of Open and Proprietary LLMs in Argumentative Writing Support

Type
conference paper
Date Issued
2024-07-02
Author(s)
Gubelmann, Reto  
;
Burkhard, Michael  
;
Ivanova, Rositsa  
;
Niklaus, Christina  
;
Bermeitinger, Bernhard  orcid-logo
;
Handschuh, Siegfried  
DOI
10.1007/978-3-031-64312-5_21
Abstract
In this article, we present the results of an exploratory study conducted with our self-developed tool Artist. The goal of the tool is to give formative feedback to develop students' argumentation skills. We compare the feedback that two different LLMs, an open-sourced one by META and one of OpenAI's fully proprietary ones, give to students' argumentative writing. We find that, overall, students find the feedback provided by both LLMs helpful (7.51 vs. 7.65 on a scale from 1 to 10), and they rate the quality of the feedback as good to very good. We take this as a very encouraging provisional result that invites larger and more extensive studies on the topic.
Keywords
Writing Support
Argument Quality
ChatGPT
Large Language Model
Computer-Supported Learning
Feedback Provision
URL
https://www.alexandria.unisg.ch/handle/20.500.14171/120866
File(s)
Loading...
Thumbnail Image

open.access

Name

24_AIED.pdf

Size

386.27 KB

Format

Adobe PDF

Checksum (MD5)

3f34109bf115fa08fa782bd9ee78038a

here you can find instructions and news.

Built with DSpace-CRIS software - Extension maintained and optimized by 4Science

  • Privacy policy
  • End User Agreement
  • Send Feedback