Now showing 1 - 10 of 14
  • Publication
    The Role of AI-Based Artifacts’ Voice Capabilities for Agency Attribution
    The pervasiveness and increasing sophistication of artificial intelligence (AI)-based artifacts within private, organizational, and social realms change how humans interact with machines. Theorizing about the way humans perceive AI-based artifacts is crucial to understanding why and to what extent humans deem these as competent for, i.e., decision-making, yet has traditionally taken a modality-agnostic view. In this paper, we theorize about a particular case of interaction, namely that of voice-based interaction with AI-based artifacts. The capabilities and perceived naturalness of such artifacts, fueled by continuous advances in natural language processing, induce users to deem an artifact as able to act autonomously in a goal-oriented manner. We argue that there is a positive direct relationship between the voice capabilities of an artifact and users’ agency attribution, ultimately obscuring the artifact’s true nature and competencies. This relationship is further moderated by an artifact’s actual agency, uncertainty, and user characteristics.
    Type:
    Journal:
    Volume:
    Issue:
  • Publication
    Charting the Evolution and Future of Conversational Agents: A Research Agenda Along Five Waves and New Frontiers
    (Springer Nature, 2023-04-20)
    Schöbel, Sofia
    ;
    ;
    Benner, Dennis
    ;
    Saqr, Mohammed
    ;
    ;
    Conversational agents (CAs) have come a long way from their first appearance in the 1960s to today's generative models. Continuous technological advancements such as statistical computing and large language models allow for an increasingly natural and effortless interaction, as well as domain-agnostic deployment opportunities. Ultimately, this evolution begs multiple questions: How have technical capabilities developed? How is the nature of work changed through humans' interaction with conversational agents? How has research framed dominant perceptions and depictions of such agents? And what is the path forward? To address these questions, we conducted a bibliometric study including over 5000 research articles on CAs. Based on a systematic analysis of keywords, topics, and author networks, we derive "five waves of CA research" that describe the past, present, and potential future of research on CAs. Our results highlight fundamental technical evolutions and theoretical paradigms in CA research. Therefore, we discuss the moderating role of big technologies, and novel technological advancements like OpenAI GPT or BLOOM NLU that mark the next frontier of CA research. We contribute to theory by laying out central research streams in CA research, and offer practical implications by highlighting the design and deployment opportunities of CAs.
    Type:
    Journal:
    Scopus© Citations 9
  • Publication
    Conversational Agents for Information Retrieval in the Education Domain: A User-Centered Design Investigation
    Text-based conversational agents (CAs) are widely deployed across a number of daily tasks, including information retrieval. However, most existing agents follow a default design that disregards user needs and preferences, ultimately leading to a lack of usage and an unsatisfying user experience. To better understand how CAs can be designed in order to lead to effective system use, we deduced relevant design requirements from both literature and 13 user interviews. We built and tested a question-answering, text-based CA for an information retrieval task in an education scenario. Results from our experimental test with 41 students indicate that following a user-centered design has a significant positive effect on enjoyment and trust in a CA as opposed to deploying a default CA. If not designed with the user in mind, CAs are not necessarily more beneficial than traditional question-answering systems. Beyond practical implications for effective CA design, this paper points towards key challenges and potential research avenues when deploying social cues for CAs.
    Type:
    Journal:
    Volume:
    Issue:
  • Publication
    Voice bots on the frontline: Voice-based interfaces enhance flow-like consumer experiences & boost service outcomes
    Voice-based interfaces provide new opportunities for firms to interact with consumers along the customer journey. The current work demonstrates across four studies that voice-based (as opposed to text-based) interfaces promote more flow-like user experiences, resulting in more positively-valenced service experiences, and ultimately more favorable behavioral firm outcomes (i.e., contract renewal, conversion rates, and consumer sentiment). Moreover, we also provide evidence for two important boundary conditions that reduce such flow-like user experiences in voice-based interfaces (i.e., semantic disfluency and the amount of conversational turns). The findings of this research highlight how fundamental theories of human communication can be harnessed to create more experiential service experiences with positive downstream consequences for consumers and firms. These findings have important practical implications for firms that aim at leveraging the potential of voice-based interfaces to improve consumers' service experiences and the theory-driven ''conversational design'' of voice-based interfaces.
    Type:
    Journal:
    Volume:
    Issue:
    Scopus© Citations 13
  • Publication
    Exploring the Synergies in Human-AI Hybrids: A Longitudinal Analysis in Sales Forecasting
    Despite the promised potential of artificial intelligence (AI), insights into real-life human-AI hybrids and their dynamics remain obscure. Based on digital trace data of over 1.4 million forecasting decisions over a 69-month period, we study the implications of an AI sales forecasting system's introduction in a bakery enterprise on decision-makers' overriding of the AI system and resulting hybrid performance. Decisionmakers quickly started to rely on AI forecasts, leading to lower forecast errors. Overall, human intervention deteriorated forecasting performance as overriding resulted in greater forecast error. The results confirm the notion that AI systems outperform humans in forecasting tasks. However, the results also indicate previously neglected, domain-specific implications: As the AI system aimed to reduce forecast error and thus overproduction, forecasting numbers decreased over time, and thereby also sales. We conclude that minimal forecast errors do not inevitably yield optimal business outcomes when detrimental human factors in decision-making are ignored.
  • Publication
    Disentangling Trust in Voice Assistants - A Configurational View on Conversational AI Ecosystems
    ( 2023) ; ;
    Bevilacqua, Tatjana
    Voice assistants’ (VAs) increasingly nuanced and natural communication via artificial intelligence (AI) opens up new opportunities for the experience of users, providing task assistance and automation possibilities, and also offer an easy interface to digital services and ecosystems. However, VAs and according ecosystems face various problems, such as low adoption and satisfaction rates as well as other negative reactions from users. Companies, therefore, need to consider what contributes to user satisfaction of VAs and related conversational AI ecosystems. Key for conversational AI ecosystems is the consideration of trust due to their agentic and pervasive nature. Nonetheless, due to the complexity of conversational AI ecosystems and different trust sources involved, we argue that we need a more detailed understanding about trust. Thus, we propose a configurational view on conversational AI ecosystems that allows us to disentangle the complex and interrelated factors that contribute to trust in VAs. We examine with a configurational approach and a survey study, how different trust sources contribute to the outcomes of conversational AI ecosystems, i.e., in our case user satisfaction. The results of our study show four distinct patterns of trust source configurations. Vice versa, we show how trust sources contribute to the absence of the outcome, i.e., user satisfaction. The derived implications provide a configurative theoretical understanding for the role of trust sources for user satisfaction that provides practitioners useful guidance for more trustworthy conversational AI ecosystems.
    Type:
    Journal:
  • Publication
    Social Audio: Conceptualizing Voice-Based Online Social Networks and their Privacy Implications
    ( 2023) ;
    Rentsch, Stefanie
    ;
    This paper explores the nature and implications of social audio: online social networks (OSNs) that enable users to interact via voice. The paper contributes to basic science by offering a precise conceptualization of voice-based OSNs and their design features. We posit that the defining characteristics of traditional OSNs also hold for social audio, yet that novel features (i.e., creating rooms) and modifications of traditional features (i.e., like) through voice idiosyncrasies can be found. This work also shows how social audio introduces novel privacy implications, particularly driven by the richness and risks of voice as an interaction modality. Using three illustrative cases, we demonstrate applications of social audio and how privacy implications remain largely unaddressed. Specifically, we find that the networks considered show very few specific features addressing the risks of voice-based interaction and that current privacy policies do not reflect these risks nor offer mitigation measures. We bridge our findings and extensions for future research by discussing potential approaches in terms of network architecture features for social audio providers to pursue in order to ensure user privacy.
    Type:
    Journal:
  • Publication
    Unleashing Process Mining for Education: Designing an IT-Tool for Students to Self-Monitor their Personal Learning Paths
    The ability of students to self-monitor their learning paths is in demand as never before due to the recent rise of online education formats, which entails less interaction with lecturers. Recent advantages in educational process mining (EPM) offer new opportunities to monitor students’ learning paths by processing log data captured by technology-mediated learning environments. However, current literature falls short on providing user-centered design principles for IT-tools which can monitor learning paths using EPM. Hence, in this paper, we examine how to design a self-monitoring tool that supports students to evaluate their learning paths. Based on theoretical insights of 66 papers and nine user interviews, we propose seven design principles for an IT-tool which facilitates self-monitoring for students based on EPM. Further, we evaluate the design principles with seven potential users. Our results demonstrate a promising approach to help students improve their self-efficacy in their individual learning process using EPM.
    Type:
    Journal:
  • Publication
    Examining Trust in Conversational Systems: Conceptual and Empirical Findings on User Trust, Related Behavior, and System Trustworthiness
    ( 2022-12-12)
    Machine learning (ML)-based conversational systems represent a value enabler for human-machine interaction. Simultaneously, the opacity, complexity, and humanness accompanied by such systems introduce their own issues, including trust misalignment. While trust is viewed as a prerequisite for effective system use, few studies have considered calibrating for appropriate trust, and empirically testing the relationship between trust and related behavior. Moreover, the desired implications of transparency-enhancing design cues are ambiguous. My research aims to explore the impact of system performance on trust, the dichotomy between trust and behavior, and how transparency might help attenuate the effects caused by low system performance in the specific context of decision-making tasks assisted by ML-based conversational systems.
    Type:
    Journal:
  • Publication
    Conceptual Foundations on Debiasing for Machine Learning-Based Software
    ( 2022-12-12) ; ;
    Fahse, Tobias Benjamin
    Machine learning (ML)-based software’s deployment has raised serious concerns about its pervasive and harmful consequences for users, business, and society inflicted through bias. While approaches to address bias are increasingly recognized and developed, our understanding of debiasing remains nascent. Research has yet to provide a comprehensive coverage of this vast growing field, much of which is not embedded in theoretical understanding. Conceptualizing and structuring the nature, effect, and implementation of debiasing instruments could provide necessary guidance for practitioners investing in debiasing efforts. We develop a taxonomy that classifies debiasing instrument characteristics into seven key dimensions. We evaluate and refine our taxonomy through nine experts and apply our taxonomy to three actual debiasing instruments, drawing lessons for the design and choice of appropriate instruments. Bridging the gaps between our conceptual understanding of debiasing for ML-based software and its organizational implementation, we discuss contributions and future research.
    Type:
    Journal: