Conceptualizing Multi-party AI Reliance for Design Research
ISBN
978-3-031-61174-2
Type
conference paper
Date Issued
2024-06-03
Author(s)
Editor(s)
Munir Mandviwalla
Matthias Söllner
Tuure Tuunanen
Abstract
Appropriate reliance on artificial intelligence (AI)-based systems is
paramount to leverage increasing AI performance. However, multi-party settings,
where multiple parties with diverging interests interact with the support of AI
systems, are currently neglected. In this study, we use Heider’s balance theory to
derive a framework that allows us to conceptualize and analyze reliance on AI
in multi-party settings. We then use this framework to analyze two large design
science research projects. First, we analyze financial advisory service encounters,
where the role inequality of advisor and client can lead to a dominance of the
advisor. Second, we analyze used car market negotiations, where the problem of
partial reliance on AI systems creates a misalignment between the two parties,
ultimately failing the negotiations. Finally, we discuss implications and future
research on AI reliance in multi-party settings and highlight that this study should
serve as a starting point in investigating AI reliance in multi-party settings.
paramount to leverage increasing AI performance. However, multi-party settings,
where multiple parties with diverging interests interact with the support of AI
systems, are currently neglected. In this study, we use Heider’s balance theory to
derive a framework that allows us to conceptualize and analyze reliance on AI
in multi-party settings. We then use this framework to analyze two large design
science research projects. First, we analyze financial advisory service encounters,
where the role inequality of advisor and client can lead to a dominance of the
advisor. Second, we analyze used car market negotiations, where the problem of
partial reliance on AI systems creates a misalignment between the two parties,
ultimately failing the negotiations. Finally, we discuss implications and future
research on AI reliance in multi-party settings and highlight that this study should
serve as a starting point in investigating AI reliance in multi-party settings.
Language
English
Book title
Design Science Research for a Resilient Future
Start page
51
End page
65
Pages
14
Event Title
19th International Conference on Design Science Research in Information Systems and Technology, DESRIST 2024
Event Location
Trollhättan, Sweden,
Event Date
June 3–5, 2024, Proceedings
Division(s)
File(s)![Thumbnail Image]()
open.access
Name
DESRIST_IBH.pdf
Size
27.72 MB
Format
Adobe PDF
Checksum (MD5)
71f2124e7265e08eb59f3e64e99b806d