Anuschka Schmitt
Thumbnail Image
Last Name
Schmitt
First name
Anuschka
Email
anuschka.schmitt@unisg.ch
Phone
+41 71 224 3225

Filters

1
1
Reset filters

Settings
Now showing 1 - 1 of 1
  • Publication
    Towards a Trust Reliance Paradox? Exploring the Gap Between Perceived Trust in and Reliance on Algorithmic Advice
    ( 2021)
    Schmitt, Anuschka
    ;
    Wambsganss, Thiemo
    ;
    Söllner, Matthias
    ;
    Janson, Andreas
    Beyond AI-based systems’ potential to augment decision-making, reduce organizational resources, and counter human biases, unintended consequences of such systems have been largely neglected so far. Researchers are undecided on whether erroneous advice acts as an impediment to system use or is blindly relied upon. As part of an experimental study, we turn towards the impact of incorrect system advice and how to design for failure-prone AI. In an experiment with 156 subjects we find that, although incorrect algorithmic advice is trusted less, users adapt their answers to a system’s incorrect recommendations. While transparency on a system’s accuracy levels fosters trust and reliance in the context of incorrect advice, an opposite effect is found for users exposed to correct advice. Our findings point towards a paradoxical gap between stated trust and actual behavior. Furthermore, transparency mechanisms should be deployed with caution as their effectiveness is intertwined with system performance.
    Type: conference paper
    Journal: International Conference on Information Systems (ICIS)
    URI: https://www.alexandria.unisg.ch/handle/20.500.14171/111308