Enhancing questioning skills through child avatar chatbot training with feedback

Loading...
Thumbnail Image
File version

Version of Record (VoR)

Author(s)
Roed, Ragnhild Klingenberg
Baugerud, Gunn Astrid
Hassan, Syed Zohaib
Sabet, Saeed S
Salehi, Pegah
Powell, Martine B
Riegler, Michael A
Halvorsen, Pal
Johnson, Miriam S
Griffith University Author(s)
Primary Supervisor
Other Supervisors
Editor(s)
Date
2023
Size
File type(s)
Location
Abstract

Training child investigative interviewing skills is a specialized task. Those being trained need opportunities to practice their skills in realistic settings and receive immediate feedback. A key step in ensuring the availability of such opportunities is to develop a dynamic, conversational avatar, using artificial intelligence (AI) technology that can provide implicit and explicit feedback to trainees. In the iterative process, use of a chatbot avatar to test the language and conversation model is crucial. The model is fine-tuned with interview data and realistic scenarios. This study used a pre-post training design to assess the learning effects on questioning skills across four child interview sessions that involved training with a child avatar chatbot fine-tuned with interview data and realistic scenarios. Thirty university students from the areas of child welfare, social work, and psychology were divided into two groups; one group received direct feedback (n = 12), whereas the other received no feedback (n = 18). An automatic coding function in the language model identified the question types. Information on question types was provided as feedback in the direct feedback group only. The scenario included a 6-year-old girl being interviewed about alleged physical abuse. After the first interview session (baseline), all participants watched a video lecture on memory, witness psychology, and questioning before they conducted two additional interview sessions and completed a post-experience survey. One week later, they conducted a fourth interview and completed another post-experience survey. All chatbot transcripts were coded for interview quality. The language model’s automatic feedback function was found to be highly reliable in classifying question types, reflecting the substantial agreement among the raters [Cohen’s kappa (κ) = 0.80] in coding open-ended, cued recall, and closed questions. Participants who received direct feedback showed a significantly higher improvement in open-ended questioning than those in the non-feedback group, with a significant increase in the number of open-ended questions used between the baseline and each of the other three chat sessions. This study demonstrates that child avatar chatbot training improves interview quality with regard to recommended questioning, especially when combined with direct feedback on questioning.

Journal Title

Frontiers in Psychology

Conference Title
Book Title
Edition
Volume

14

Issue
Thesis Type
Degree Program
School
Publisher link
Patent number
Funder(s)
Grant identifier(s)
Rights Statement
Rights Statement

© 2023 Røed, Baugerud, Hassan, Sabet, Salehi, Powell, Riegler, Halvorsen and Johnson. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

Item Access Status
Note
Access the data
Related item(s)
Subject

Biomedical and clinical sciences

Psychology

Social Sciences

Psychology, Multidisciplinary

investigative interviewing

child abuse

Persistent link to this record
Citation

Roed, RK; Baugerud, GA; Hassan, SZ; Sabet, SS; Salehi, P; Powell, MB; Riegler, MA; Halvorsen, P; Johnson, MS, Enhancing questioning skills through child avatar chatbot training with feedback, Frontiers in Psychology, 2023, 14, pp. 1198235

Collections