Options
Reto Gubelmann
Title
Dr.
Last Name
Gubelmann
First name
Reto
Email
reto.gubelmann@unisg.ch
Phone
+41 71 224 75 25
Now showing
1 - 10 of 11
-
PublicationCapturing the Varieties of Natural Language Inference: A Systematic Survey of Existing Datasets and Two Novel Benchmarks( 2023-11-20)
;Katis, IoannisTransformer-based Pre-Trained Language Models currently dominate the field of Natural Language Inference (NLI). We first survey existing NLI datasets, and we systematize them according to the different kinds of logical inferences that are being distinguished. This shows two gaps in the current dataset landscape, which we propose to address with one dataset that has been developed in argumentative writing research as well as a new one building on syllogistic logic. Throughout, we also explore the promises of ChatGPT. Our results show that our new datasets do pose a challenge to existing methods and models, including ChatGPT, and that tackling this challenge via fine-tuning yields only partly satisfactory results.Type: journal articleJournal: Journal of Logic, Language and Information -
PublicationContext Matters: A Pragmatic Study of PLMs’ Negation UnderstandingIn linguistics, there are two main perspectives on negation: a semantic and a pragmatic view. So far, research in NLP on negation has almost exclusively adhered to the semantic view. In this article, we adopt the pragmatic paradigm to conduct a study of negation understanding focusing on transformer-based PLMs. Our results differ from previous, semantics-based studies and therefore help to contribute a more comprehensive – and, given the results, much more optimistic – picture of the PLMs’ negation understanding.Type: journal articleJournal: Proceedings of the 60th Annual Meeting of the Association for Computational LinguisticsVolume: 1
-
PublicationType: journal articleVolume: 04/2022
-
PublicationType: journal article
-
PublicationA Philosophically-Informed Contribution to the Generalization Problem of Neural Natural Language Inference: Shallow Heuristics, Bias, and the Varieties of Inference(Association for Computational Linguistics, 2022)Type: journal article
-
PublicationMaddy vs. Quine on Innate Concepts. Revisiting A Perennial Debate in Light of Recent Empirical ResultsIn his posthumously published work, Quine abandons his empiricist principle that humans do not have any innate concepts, or knowledge. He does so in light of empirical research that Penelope Maddy capitalizes on to develop her own naturalized epistemology. The empirical research in question is due to the pioneering work of developmental psychologist Elisabeth Spelke. Spelke employs the method of habituation and preferential looking to argue that human infants have innate concepts, and that they have some knowledge about what can and cannot happen to physical objects. Taking into account empirical studies as well as methodological considerations, this article examines whether this research can support these strong philosophical conclusions drawn from it, finding that it likely cannot provide such support.Type: journal articleJournal: PhilosophiaVolume: 48
-
PublicationFROM SHARED STIMULI TO PREESTABLISHED HARMONY: THE DEVELOPMENT OF QUINE’S THINKING ON INTERSUBJECTIVITY AND OBJECTIVE VALIDITY( 2019-10)W. V. O. Quine is generally seen as one of the foremost empiricists of the twentieth century. For large parts of his career, the label “empiricist” is accurate; in his mature work, however, he integrated decidedly antiempiricist elements in his epistemology. From The Roots of Reference onward, he enlists natural selection and innate cognitive structures to ensure that scientific concepts have a “degree of objective validity.” From From Stimulus to Science onward, he also explains the very possibility of communication via a preestablished harmony of innate cognitive structures that is guaranteed by natural selection. This article reconstrues the reasons that compelled Quine to these commitments, and it details the development of Quine’s thinking on these topics across more than 3 decades; in particular, the article argues that recognizing that so-called stimulus meanings are private decisively shaped Quine’s views. By means of a critical evaluation, the article argues that natural selection can make plausible that scientific concepts have a degree of objective validity—if this Quinean claim is properly understood; in contrast, the article suggests, with recourse to research by Robert C. Richardson, that it is doubtful whether natural selection can underpin the preestablished harmony that Quine requires to explain communication.Type: journal articleJournal: HOPOS: The Journal of the International Society for the History of Philosophy of ScienceVolume: 9
-
PublicationWhen Truth Matters - Addressing Pragmatic Categories in Natural Language Inference (NLI) by Large Language Models (LLMs)( 2023-07)
;Kalouli, Aikaterini-LidaIn this paper, we focus on the ability of large language models (LLMs) to accommodate different pragmatic sentence types, such as questions, commands, as well as sentence fragments for natural language inference (NLI). On the commonly used notion of logical inference, nothing can be inferred from a question, a command, or an incomprehensible sentence fragment. We find MNLI, arguably the most important NLI dataset, and hence models fine-tuned on this dataset, insensitive to this fact. Using a symbolic semantic parser, we develop and make publicly available, fine-tuning datasets designed specifically to address this issue, with promising results. We also make a first exploration of ChatGPT's concept of entailment.Type: conference paperJournal: Proceedings of the 12th Joint Conference on Lexical and Computational Semantics (*SEM 2023) -
PublicationComputer Supported Argumentation Learning: Design of a Learning Scenario in Academic Writing by Means of a Conjecture Map( 2023)Patcharin PanjabureeIn academic writing, the competency to argue is important. However, first-year students often have difficulties to construct good arguments. Advances in natural language processing (NLP) have made it possible to better analyze the writing quality of texts. New tools have emerged which can give students individual feedback on their texts and the structure of their arguments. While the use of these argumentation learning support tools can help create better texts, using them in an academic context also carries risks. Learning scenarios are needed that promote argumentation competency using argumentation tools while also making students aware of their limitations. To address this issue, this paper investigates how a learning design with an argumentation learning support tool can be developed to increase the argumentation competency of first-year students. The conjecture-mapping technique was used, to visualize our assumptions and illustrate the developed learning design. As part of a fi rst design cycle, the learning design was tested with 80 students in seven academic writing classes at the University of St.Gallen in Switzerland. Preliminary findings suggest that the learning design might be helpful to improve the argumentation competency as well as the data-literacy of students (in relation to argumentation tools). However, further research is necessary to confirm or reject our hypotheses.Type: conference paperJournal: Proceedings of the 15th International Conference on Computer Supported EducationVolume: 1
-