| Item Type |
Conference or Workshop Item
(Paper)
|
| Abstract |
Designing for system trustworthiness promises to address challenges of opaqueness and uncertainty introduced through Machine Learning (ML)-based systems by allowing users to understand and interpret systems’ underlying working mechanisms. However, empirical exploration of trustworthiness measures and their effectiveness is scarce and inconclusive. We investigated how varying model confidence (70% versus 90%) and making confidence levels transparent to the user (explanatory statement versus no explanatory statement) may influence perceptions of trust and performance in an information retrieval task assisted by a conversational system. In a field experiment with 104 users, our findings indicate that neither model confidence nor transparency seem to impact trust in the conversational system. However, users’ task performance is positively influenced by both transparency and trust in the system. While this study considers the complex interplay of system trustworthiness, trust, and subsequent behavioral outcomes, our results call into question the relation between system trustworthiness and user trust. |
| Authors |
Schmitt, Anuschka; Wambsganss, Thiemo & Janson, Andreas |
| Research Team |
IWI6 |
| Journal or Publication Title |
European Conference on Information Systems (ECIS) |
| Language |
English |
| Keywords |
Trust, Trustworthiness, Transparency, Machine Learning, Information Retrieval, Pedagogical Conversational Agents |
| Subjects |
information management |
| HSG Classification |
contribution to scientific community |
| Date |
24 June 2022 |
| Place of Publication |
Timișoara, Romania |
| Event Title |
European Conference on Information Systems (ECIS) |
| Event Location |
Timișoara, Romania |
| Event Dates |
18-24 Jun 2022 |
| Official URL |
https://pubs.wi-kassel.de/wp-content/uploads/2022/... |
| Depositing User |
Anonymous Anonymous
|
| Date Deposited |
03 Aug 2022 11:19 |
| Last Modified |
30 Nov 2022 17:18 |
| URI: |
https://www.alexandria.unisg.ch/publications/266811 |
Designing for Conversational System Trustworthiness: The Impact of Model Transparency on Trust and Task Performance
![[img]](http://www.alexandria.unisg.ch/style/images/fileicons/oa_orange.png)
