Now showing 1 - 10 of 85
No Thumbnail Available
Publication

Worked Examples to Facilitate the Development of Prompt Engineering Skills

2024 , Antonia Tolzin , Nils Knoth , Andreas Janson

This paper explores the evolving field of prompt engineering in Artificial Intelligence (AI), with a focus on Large Language Models (LLMs). As LLMs exhibit remarkable potential in various educational domains, their effective use requires adept prompt engineering skills. We introduce a skill-based approach to prompt engineering and explicitly investigate the impact of using worked examples to facilitate prompt engineering skills among students interacting with LLMs. We propose hypotheses linking prompt engineering, worked examples, and perceived anthropomorphism to the quality of LLM output. Our initial findings support the critical relationship between proficient prompt engineering and the resulting output quality of LLMs. Subsequent phases will further explore the role of worked examples in prompt engineering, aiming to provide practical recommendations for educational improvement and industry application. Additionally, this research aims to shed light on the responsible utilization of LLMs in education and contribute insights to educational practice, research, and organizational development.

No Thumbnail Available
Publication

Sharing Design Knowledge Through Codification in Interdisciplinary DSR Collaborations

2023-01-06 , Dickhaut, Ernestine , Janson, Andreas , Hevner, Alan , Leimeister, Jan Marco

The goals of design science research (DSR) projects are to generate novel and useful artifacts and to produce rigorous and generalizable design knowledge. Often, DSR projects are conducted in collaborative, interdisciplinary project teams. Different disciplinary approaches to codifying design knowledge result in challenging project interactions. To study this situation, we analyze design knowledge codification in interdisciplinary teams over time. We gain insights from a survey of recent DSR papers that have been published in the AIS Senior Scholars’ Basket. We then present a detailed case study of a longitudinal project that brought to light issues of sharing design knowledge across disciplinary borders. Drawing from the survey and case study, we provide actionable guidance on how to effectively codify and share design knowledge to support researchers and practitioners to build useful artifacts and to make interdisciplinary design knowledge contributions reusable and applicable.

No Thumbnail Available
Publication

Disentangling Trust in Voice Assistants - A Configurational View on Conversational AI Ecosystems

2023 , Janson, Andreas , Schmitt, Anuschka , Bevilacqua, Tatjana

Voice assistants’ (VAs) increasingly nuanced and natural communication via artificial intelligence (AI) opens up new opportunities for the experience of users, providing task assistance and automation possibilities, and also offer an easy interface to digital services and ecosystems. However, VAs and according ecosystems face various problems, such as low adoption and satisfaction rates as well as other negative reactions from users. Companies, therefore, need to consider what contributes to user satisfaction of VAs and related conversational AI ecosystems. Key for conversational AI ecosystems is the consideration of trust due to their agentic and pervasive nature. Nonetheless, due to the complexity of conversational AI ecosystems and different trust sources involved, we argue that we need a more detailed understanding about trust. Thus, we propose a configurational view on conversational AI ecosystems that allows us to disentangle the complex and interrelated factors that contribute to trust in VAs. We examine with a configurational approach and a survey study, how different trust sources contribute to the outcomes of conversational AI ecosystems, i.e., in our case user satisfaction. The results of our study show four distinct patterns of trust source configurations. Vice versa, we show how trust sources contribute to the absence of the outcome, i.e., user satisfaction. The derived implications provide a configurative theoretical understanding for the role of trust sources for user satisfaction that provides practitioners useful guidance for more trustworthy conversational AI ecosystems.

No Thumbnail Available
Publication

Social Audio: Conceptualizing Voice-Based Online Social Networks and their Privacy Implications

2023 , Schmitt, Anuschka , Rentsch, Stefanie , Janson, Andreas

This paper explores the nature and implications of social audio: online social networks (OSNs) that enable users to interact via voice. The paper contributes to basic science by offering a precise conceptualization of voice-based OSNs and their design features. We posit that the defining characteristics of traditional OSNs also hold for social audio, yet that novel features (i.e., creating rooms) and modifications of traditional features (i.e., like) through voice idiosyncrasies can be found. This work also shows how social audio introduces novel privacy implications, particularly driven by the richness and risks of voice as an interaction modality. Using three illustrative cases, we demonstrate applications of social audio and how privacy implications remain largely unaddressed. Specifically, we find that the networks considered show very few specific features addressing the risks of voice-based interaction and that current privacy policies do not reflect these risks nor offer mitigation measures. We bridge our findings and extensions for future research by discussing potential approaches in terms of network architecture features for social audio providers to pursue in order to ensure user privacy.

No Thumbnail Available
Publication

Engaging Minds – How Gamified Chatbots can Support and Motivate Learners in Digital Education

2024-01-06 , Dennis Benner , Sofia Schöbel , Andreas Janson , Jan Marco Leimeister

Blended and online learning is growing, and self-regulated learning is becoming more relevant. Most often, students struggle with organizing their own learning processes, lose focus or procrastinate. Keeping learners motivated and engaged can be a real challenge. Therefore, we present gamified chatbots as a potential solution. On the one hand, chatbots can provide a more engaging learning experience. On the other hand, gamification can provide motivational incentives to keep learners engaged and motivated. So far, not many studies have elaborated on how gamification can be effectively used to make a chatbot interaction more engaging or improve the learning experience. This study uses an experimental approach to distinguish how a combination of badges and a progress bar can support and motivate learners to stay engaged with their learning activities. We elaborate on the effects of gamified chatbots and support practitioners with guidance on how to design gamified chatbots in education.

No Thumbnail Available
Publication

How Videoconferencing and its Affordances Transformed Teaching in Schools During COVID-19 Pandemic

2023-12-06 , Dickhaut, Ernestine , Li, Mahei Manhai , Janson, Andreas

The COVID-19 pandemic has brought about major changes in digitization in many areas of life and professions. New areas were digitized almost overnight, the school system in Germany was no exception leading to a demand for videoconferencing tools and communication platforms. These technologies have many different functionalities that need to be discovered, explored, and exploited by the user. Given the disruptive events that the COVID pandemic brought to us, this paper aims to shed light on how the dynamics of discovery, exploration, and exploitation unfolds. We use a functional affordance theory perspective to analyze and understand how user learn to use new technologies. To do this, we conducted an exploratory case-study-based research design including interviews with teachers from various schools to analyze how they appropriate new technologies to develop an explanatory theoretical model.

No Thumbnail Available
Publication

Automotive Manufacturers and Their Stumble from one Supply Crisis to Another: Procurement Departments Could be the Game Changer by Using Data Analytics, but…

2023-01-06 , Klee, Sven , Janson, Andreas , Leimeister, Jan Marco

With this paper, we examine the use of data analytics for crisis management in automotive procurement departments. Possible business values of data analytics were part of numerous research approaches. Nevertheless, automotive manufacturers are repeatedly confronted with supply chain disruptions. Procurement departments have a central role within supply chains and are predominantly responsible for stable supply processes. Taking into account the potential of data analytics, such crises should be avoided or at least mitigated. Thus, there is the question, why data analytics cannot currently help automotive procurement departments by facing such crises. We therefore evaluate problems and obstacles by implementing and using data analytics in automotive procurement departments. Therefore, we talk to experienced procurement experts for evaluating practical insights. With our findings we provide practical insights and applicable recommendations for action with the goal of helping procurement leaders to better leverage data analytics for meeting current and future crises.

No Thumbnail Available
Publication

Designing Pedagogical Conversational Agents for Achieving Common Ground

2023 , Antonia Tolzin , Anita Körner , Ernestine Dickhaut , Andreas Janson , Ralf Rummer , Jan Marco Leimeister

As educational organizations face difficulties in providing personalized learning material or individual learning support, pedagogical conversational agents (PCAs) promise individualized learning for students. However, the problem of conversational breakdowns of PCAs and consequently poor learning outcomes still exist. Hence, effective and grounded communication between learners and PCAs is fundamental to improving learning processes and out-comes. As understanding each other and the conversational grounding is crucial for conversations between humans and PCAs, we propose common ground theory as a foundation for designing a PCA. Conducting a design science research project, we propose theory-motivated design principles and instantiate them in a PCA. We evaluate the utility of the artifact with an experimental study in higher education to inform the subsequent design iterations. We contribute design knowledge on conversational agents in learning settings, enabling researchers and practitioners to develop PCAs based on common ground research in education and providing avenues for future research. Thereby, we can secure further understanding of learning processes based on grounding communication.

No Thumbnail Available
Publication

Meetings at Digital Workplaces – An Experimental Approach to Analyze Group Attachment and Organizational Commitment in Digital Worlds

2023 , Gleich, Tristan , Schöbel, Sofia , Janson, Andreas

After facing the COVID-19 pandemic, organizations request their employees to work from home permanently. For an organization, this provides positive benefits such as reducing costs for rent. From an employee perspective, working from home can cause a feeling of isolation towards co-workers and lower attachment to an organization. One way to counteract this problem is to transfer the office to the digital world, especially spurred by the metaverse discussion to represent processes of our real world in digital environments that allow us to do everything in the same way digitally as we are doing in the real world. In this paper, we present a theoretical model for conducting a 2x2 between-subject experiment to analyze how digital real-world meeting experiences influence team attachment and organizational commitment. We contribute to theories such as the need of belonging and transfer them to digital environments and provide practical implications for designing digital offices.

No Thumbnail Available
Publication

Designing for Digital Wellbeing on a Smartphone: Co-creation of Digital Nudges to Mitigate Instagram Overuse

2023-01-03 , Purohit, Aditya Kumar , Barev, Torben Jan , Schöbel, Sofia , Janson, Andreas , Holzer, Adrian

The endless stream of social media newsfeeds and stories captivates users for hours on end, sometimes exceeding what users themselves consider unhealthy. However, reducing one's social media consumption has proven to be challenging. To address this issue, this study investigates how the co-creation of the digital feedback nudge can improve digital well-being without increasing privacy threats. To achieve this goal, a mixed method study is used through a two-week pre-post study design. Results demonstrate that co-creation significantly increased users' sense of agency, sense of accomplishment and perceived sense of privacy while reducing users' privacy concern. Furthermore, the feedback nudge allowed participants to significantly decrease their social media use.