Validation of a multi-source feedback tool for use in general practice

View/ Open
Author(s)
Campbell, J
Narayanan, A
Burford, B
Greco, M
Griffith University Author(s)
Year published
2010
Metadata
Show full item recordAbstract
Feedback from colleagues and patients is a core element of the revalidation process being developed by the General Medical Council. However, there are few feedback tools which have been specifically developed and validated for doctors in primary care. This paper presents data demonstrating the reliability and validity of one such tool. The CFEP360 tool combines feedback from the Colleague Feedback Evaluation Tool (CFET) and the Doctor's Interpersonal Skills Questionnaire (DISQ). The analysis of over 10 000 completed questionnaires presented here identifies that colleague feedback is essentially two-dimensional (i.e. ...
View more >Feedback from colleagues and patients is a core element of the revalidation process being developed by the General Medical Council. However, there are few feedback tools which have been specifically developed and validated for doctors in primary care. This paper presents data demonstrating the reliability and validity of one such tool. The CFEP360 tool combines feedback from the Colleague Feedback Evaluation Tool (CFET) and the Doctor's Interpersonal Skills Questionnaire (DISQ). The analysis of over 10 000 completed questionnaires presented here identifies that colleague feedback is essentially two-dimensional (i.e. clinical and non-clinical skills) and that patient feedback is one-dimensional. However, items from both scales also effectively predict combined global ratings, indicating that colleagues and patients are identifying similar levels of performance as accessed by the feedback. Doctors who receive low feedback scores may require further attention, meaning the feedback potentially has diagnostic value. Reliable feedback on this tool, as indicated by this analysis, requires 14 colleague responses and 25 patient responses, figures comparable to other MSF tools if CFEP360 is to be used for a high stakes performance evaluation and possible revalidation (generalisability statistic G=0.80). For lower stakes performance evaluations, such as personal development, responses from 11 colleagues and 16 patients will still return reliable results (G=0.70).
View less >
View more >Feedback from colleagues and patients is a core element of the revalidation process being developed by the General Medical Council. However, there are few feedback tools which have been specifically developed and validated for doctors in primary care. This paper presents data demonstrating the reliability and validity of one such tool. The CFEP360 tool combines feedback from the Colleague Feedback Evaluation Tool (CFET) and the Doctor's Interpersonal Skills Questionnaire (DISQ). The analysis of over 10 000 completed questionnaires presented here identifies that colleague feedback is essentially two-dimensional (i.e. clinical and non-clinical skills) and that patient feedback is one-dimensional. However, items from both scales also effectively predict combined global ratings, indicating that colleagues and patients are identifying similar levels of performance as accessed by the feedback. Doctors who receive low feedback scores may require further attention, meaning the feedback potentially has diagnostic value. Reliable feedback on this tool, as indicated by this analysis, requires 14 colleague responses and 25 patient responses, figures comparable to other MSF tools if CFEP360 is to be used for a high stakes performance evaluation and possible revalidation (generalisability statistic G=0.80). For lower stakes performance evaluations, such as personal development, responses from 11 colleagues and 16 patients will still return reliable results (G=0.70).
View less >
Journal Title
Education for Primary Care
Volume
21
Issue
3
Copyright Statement
© 2010 Radcliffe Publishing Ltd. This is a pre-copy-editing, author-produced PDF of an article accepted for publication in Education for Primary Care following peer review. The definitive version [Validation of a multi-source feedback tool for use in general practice, Vol21(3), pp. 165-179] is available online at: http://www.ingentaconnect.com/content/rmp/epc/2010/00000021/00000003/art00006.
Subject
Medical and Health Sciences not elsewhere classified
Public Health and Health Services