Do clinicians understand quality metric data? An evaluation in a twitter-derived sample
File version
Accepted Manuscript (AM)
Author(s)
Chopra, V
Iwashyna, TJ
Griffith University Author(s)
Primary Supervisor
Other Supervisors
Editor(s)
Date
Size
File type(s)
Location
License
Abstract
OBJECTIVE: Despite significant efforts and cost, quality metrics do not consistently influence practice. While research has focused on improving data through statistical risk-adjustment, whether clinicians understand these data is unknown. Therefore, we assessed clinician comprehension of central line-associated blood stream infection (CLABSI) quality metric data. DESIGN: Cross-sectional survey with an 11-item test of CLABSI data comprehension. Each question assessed 1 of 3 concepts concerning CLABSI understanding: basic numeracy, risk-adjustment numeracy, and risk-adjustment interpretation. Hypothetical data were used and presented in a validated format. PARTICIPANTS: Clinicians were recruited from 6 nations via Twitter to take an online survey. Clinician eligibility was confirmed by assessing responses to a question regarding CLABSI. MAIN MEASURES: The primary outcome was percent correct of attempted questions pertaining to the presented CLABSI data. RESULTS: Ninety-seven clinicians answered at least 1 item, providing 939 responses; 72 answered all 11 items. The mean percentage of correct answers was 61% (95% confidence interval [CI], 57%-65%). Overall, doctor performance was better than performance by nurses and other respondents (68% [95% CI, 63%-73%] vs. 57% [95% CI, 52%- 62%], P = 0.003). In basic numeracy, mean percent correct was 82% (95% CI, 77%-87%). For risk-adjustment numeracy, the mean percent correct was 70% (95% CI, 64%-76%). Risk-adjustment interpretation had the lowest average percent correct, 43% (95% CI, 37%-49%). All pairwise differences between concepts were statistically significant at P <0.05. CONCLUSIONS: CLABSI quality metric comprehension appears low and varies substantially among clinicians. These findings may contribute to the limited impact of quality metric reporting programs, and further research is needed.
Journal Title
Journal of Hospital Medicine
Conference Title
Book Title
Edition
Volume
12
Issue
1
Thesis Type
Degree Program
School
Publisher link
DOI
Patent number
Funder(s)
Grant identifier(s)
Rights Statement
Rights Statement
© 2017 Society of Hospital Medicine published by Blackwell Verlag GmbH. This is the peer reviewed version of the following article: Do clinicians understand quality metric data? An evaluation in a twitter-derived sample, Journal of Hospital Medicine, 12 (1), pp. 18-22, which has been published in final form at http://doi.org/10.1002/jhm.2680. This article may be used for non-commercial purposes in accordance with Wiley Terms and Conditions for Use of Self-Archived Versions. This article may not be enhanced, enriched or otherwise transformed into a derivative work, without express permission from Wiley or by statutory rights under applicable legislation. Copyright notices must not be removed, obscured or modified. The article must be linked to Wiley’s version of record on Wiley Online Library and any embedding, framing or otherwise making available the article or pages thereof by third parties from platforms, services and websites other than Wiley Online Library must be prohibited.
Item Access Status
Note
Access the data
Related item(s)
Subject
Clinical sciences
Persistent link to this record
Citation
Govindan, S; Chopra, V; Iwashyna, TJ, Do clinicians understand quality metric data? An evaluation in a twitter-derived sample, Journal of Hospital Medicine, 2017, 12 (1), pp. 18-22