Inter-rater reliability of the Hayes Ability Screening Index in a population of Australian prisoners
View/ Open
File version
Accepted Manuscript (AM)
Author(s)
Young, JT
van Dooren, K
Lennox, NG
Butler, TG
Kinner, SA
Griffith University Author(s)
Year published
2015
Metadata
Show full item recordAbstract
Background: Reliable ascertainment of intellectual disability (ID) is important to identify those with special needs, in order for those needs to be met in the criminal justice system. Although the Hayes Ability Screening Index (HASI) is valid and widely used for the identification of possible ID, the risk of inter-rater bias between researchers when scoring the HASI has not yet been established. The current paper estimates the inter-rater reliability of the HASI in a sample of Indigenous and non-Indigenous prisoners in Western Australia. Methods: We estimated intra-class correlation coefficients (ICC) for the consistency ...
View more >Background: Reliable ascertainment of intellectual disability (ID) is important to identify those with special needs, in order for those needs to be met in the criminal justice system. Although the Hayes Ability Screening Index (HASI) is valid and widely used for the identification of possible ID, the risk of inter-rater bias between researchers when scoring the HASI has not yet been established. The current paper estimates the inter-rater reliability of the HASI in a sample of Indigenous and non-Indigenous prisoners in Western Australia. Methods: We estimated intra-class correlation coefficients (ICC) for the consistency of agreement among three blinded raters using a two-way random-effects model assessing the inter-rater agreement of the HASI. Kappa was also estimated for the dichotomous HASI screening threshold outcome between the raters. Results: The HASI exhibited very good within-subject consistency of agreement for Section B (ICC?=?0.95; 95%CI:0.94-0.96), Section C (ICC?=?0.97; 95%CI: 0.96-0.98) and Section D (ICC?=?0.90; 95%CI: 0.87-0.92) subscales and for the total scaled score (ICC?=?0.97; 95%CI: 0.96-0.98). The inter-rater reliability of the dichotomous adult ID screening threshold (<85) was also very good (Kappa?=?0.95). Conclusions: The current study provides new evidence that the HASI has a low risk of bias from between-rater scoring and can be reliably scored by both non-clinicians and clinicians with little training, when administered in prison settings. Pre-scoring training should focus on the more subjective 'clock-drawing' section, in order to maximise inter-rater reliability.
View less >
View more >Background: Reliable ascertainment of intellectual disability (ID) is important to identify those with special needs, in order for those needs to be met in the criminal justice system. Although the Hayes Ability Screening Index (HASI) is valid and widely used for the identification of possible ID, the risk of inter-rater bias between researchers when scoring the HASI has not yet been established. The current paper estimates the inter-rater reliability of the HASI in a sample of Indigenous and non-Indigenous prisoners in Western Australia. Methods: We estimated intra-class correlation coefficients (ICC) for the consistency of agreement among three blinded raters using a two-way random-effects model assessing the inter-rater agreement of the HASI. Kappa was also estimated for the dichotomous HASI screening threshold outcome between the raters. Results: The HASI exhibited very good within-subject consistency of agreement for Section B (ICC?=?0.95; 95%CI:0.94-0.96), Section C (ICC?=?0.97; 95%CI: 0.96-0.98) and Section D (ICC?=?0.90; 95%CI: 0.87-0.92) subscales and for the total scaled score (ICC?=?0.97; 95%CI: 0.96-0.98). The inter-rater reliability of the dichotomous adult ID screening threshold (<85) was also very good (Kappa?=?0.95). Conclusions: The current study provides new evidence that the HASI has a low risk of bias from between-rater scoring and can be reliably scored by both non-clinicians and clinicians with little training, when administered in prison settings. Pre-scoring training should focus on the more subjective 'clock-drawing' section, in order to maximise inter-rater reliability.
View less >
Journal Title
Journal of Intellectual Disability Research
Volume
59
Issue
11
Copyright Statement
© 2015 John Wiley & Sons Ltd. This is the peer reviewed version of the following article: Inter‐rater reliability of the Hayes Ability Screening Index in a sample of Australian prisoners, Journal of Intellectual Disability Research, Volume 59, Issue 11, Pages 1055-1060, 2015, which has been published in final form at https://doi.org/10.1111/jir.12198. This article may be used for non-commercial purposes in accordance with Wiley Terms and Conditions for Self-Archiving (http://olabout.wiley.com/WileyCDA/Section/id-828039.html)
Subject
Biomedical and clinical sciences
Education
Psychology
Other psychology not elsewhere classified