Measuring the equity of risk assessment instruments used in child protection

No Thumbnail Available
File version
Author(s)
Jenkins, BQ
Griffith University Author(s)
Primary Supervisor
Other Supervisors
Editor(s)
Date
2021
Size
File type(s)
Location
License
Abstract

Background: It is not enough for risk assessment tools to be accurate at an aggregate level; they must also operate equitably across racial groups. Objective: This paper identifies and evaluates approaches to measuring the equity of risk assessment instruments. Participants and setting: NA. Methods: The paper draws on literature in child protection as well as other fields where equity is important including employment and criminal justice. Results: Two dimensions of equity were identified. Avoidance of prejudice can be measured qualitatively by assessing the underpinning logic of a tool. Literature has focused on avoiding unconscious bias, which fails to capture both direct and indirect discrimination. Comparative validity can be measured quantitatively by comparing actual and predicted rates of recurrence for children of different groups. This can be achieved by comparing both sensitivity and specificity, or receiver operator characteristics. However, child protection literature has relied primarily on crossover, which cannot be used to make valid comparisons between groups with different overall rates of recurrence. For example, if the recurrence rate in Community A is half that in Community B (30% vs 60%), a risk assessment could avoid crossover with wide discrepancies in numbers of false positives (25% vs 1.3%) and false negatives (39.3% vs 89.4%) observed in each community. Conclusions: Current methods for measuring equity of child protection risk assessments, including crossover, are likely to exacerbate rather than ameliorate inequity. Evaluations of equity should use valid measures of comparative validity and ensure tools consider what people do, rather than who they resemble.

Journal Title

Children and Youth Services Review

Conference Title
Book Title
Edition
Volume

131

Issue
Thesis Type
Degree Program
School
Publisher link
Patent number
Funder(s)
Grant identifier(s)
Rights Statement
Rights Statement
Item Access Status
Note
Access the data
Related item(s)
Subject

Social work

Sociology

Criminology

Persistent link to this record
Citation

Jenkins, BQ, Measuring the equity of risk assessment instruments used in child protection, Children and Youth Services Review, 2021, 131, pp. 106266

Collections