A survey of the quality of web based information on the treatment of schizophrenia and Attention Deficit Hyperactivity Disorder

Abstract

Objective: To systematically assess the quality, accountability and readability of Internet information on the treatment of schizophrenia and Attention Deficit Hyperactivity Disorder (ADHD), using a standardized pro forma. Method: We analysed the 20 most highly ranked pages on the treatment of ADHD and schizophrenia, identified by five common Internet search engines. Results: There was little overlap in the sites identified by different search engines. In the case of schizophrenia, one site was identified three times and another eight sites twice; while for ADHD four sites were identified twice. Accountability (Silberg score), presentation and readability, as assessed by the Flesch-Kincaid Grade Level score, were poor. Mean Silberg, presentation and Flesch-Kincaid Grade Level scores were 3.2 (range 0-9) out of 9, 1.9 (range 0-4) out of 4, and 11.5 (range 6.5-12.25), respectively. There was no statistical difference in scores between the two diagnoses. Depending on the recommendation, agreement with evidence-based practice for schizophrenia ranged from only 2 to 55% (mean = 2.8 (range 0-9) out of 12), while that for ADHD was from 14 to 54% (mean = 1.6 (range 0-6) out of 6). Only 50% of the sites advised readers to clarify information with an appropriate health professional. Interrater reliability in pro forma scores for schizophrenia and ADHD was high (r = 0.96 and 0.95, respectively, p < 0.0001). Sites in the top 10% of scores were significantly more likely to be owned by an organization or have an editorial board than those in the bottom 10%. Conclusions: The Internet contains misleading information on both schizophrenia and ADHD. The methodology used in this paper could be adapted for other psychiatric conditions.