Effective Stereotypical Bias Detection: The Impact of Human-AI Collaboration Modes on Human Reliance on AI Recommendation

Loading...
Thumbnail Image
File version

Version of Record (VoR)

Author(s)
Mou, Danlei
Cui, Tingru
Holtta-Otto, Katja
DU, Bo
Tong, Jiawei
Griffith University Author(s)
Primary Supervisor
Other Supervisors
Editor(s)
Date
2024
Size
File type(s)
Location

Canberra, Australia

Abstract

As artificial intelligence (AI) increasingly supports human decision-making across various domains, from hiring processes to legal judgments, understanding how to optimize human-AI collaboration is crucial for developing trustworthy and effective systems. This study explores the impact of different human-AI collaboration modes on collaboration effectiveness and users’ reliance on AI recommendations, particularly in the context of detecting stereotypical biases. Drawing on the literature of conjoined agency between humans and AI, this study differentiates between three distinct modes of human-AI collaboration— “human initiates task and AI assists,” “AI screens all tasks and human assists,” and “AI automation with human oversight”—and examines their varying effects on bias detection and human acceptance of AI recommendations. Additionally, we test the moderating role of equivocality in decision-making. Our study employs a 4x2 experimental design, including a fully manual control group, to test these hypotheses. This research contributes to the theoretical understanding of human-AI interaction and provides practical insights for designing more equitable and trusted AI systems.

Journal Title
Conference Title

ACIS 2024 Proceedings

Book Title
Edition
Volume
Issue
Thesis Type
Degree Program
School
DOI
Patent number
Funder(s)
Grant identifier(s)
Rights Statement
Rights Statement

© 2024 Mou et al. This is an open-access article licensed under a Creative Commons Attribution-Non-Commercial 4.0 Australia License, which permits non-commercial use, distribution, and reproduction in any medium, provided the original author and ACIS are credited.

Item Access Status
Note
Access the data
Related item(s)
Subject
Persistent link to this record
Citation

Mou, D; Cui, T; Holtta-Otto, K; DU, B; Tong, J, Effective Stereotypical Bias Detection: The Impact of Human-AI Collaboration Modes on Human Reliance on AI Recommendation, ACIS 2024 Proceedings, 2024, pp. 146