Show simple item record

dc.contributor.authorSong, S
dc.contributor.authorBu, J
dc.contributor.authorArtmeier, A
dc.contributor.authorShi, K
dc.contributor.authorWang, Y
dc.contributor.authorYu, Z
dc.contributor.authorWang, C
dc.description.abstractWeb accessibility evaluation examines how well websites comply with accessibility guidelines which help people with disabilities to perceive, navigate and contribute to the Web. This demanding task usually requires manual assessment by experts with many years of training and experience. However, not enough experts are available to carry out the increasing number of evaluation projects while non-experts often have different opinions about the presence of accessibility barriers. Addressing these issues, we introduce a crowdsourcing system with a novel truth inference algorithm to derive reliable and accurate assessments from conflicting opinions of evaluators. Extensive evaluation on 23,901 complex tasks assessed by 50 people with and without disabilities shows that our approach outperforms state of the art approaches. In addition, we conducted surveys to identify frequent barriers that people with disabilities are facing in their daily lives and the difficulty to access Web pages when they encounter these barriers. The frequencies and severities of barriers correlate with their derived importance in our evaluation project.
dc.publisherAssociation for Computing Machinery (ACM)
dc.relation.ispartofjournalProceedings of the ACM on Human-Computer Interaction
dc.subject.fieldofresearchInformation and Computing Sciences
dc.titleCrowdsourcing-based web accessibility evaluation with golden maximum likelihood inference
dc.typeJournal article
dc.type.descriptionC1 - Articles
dcterms.bibliographicCitationSong, S; Bu, J; Artmeier, A; Shi, K; Wang, Y; Yu, Z; Wang, C, Crowdsourcing-based web accessibility evaluation with golden maximum likelihood inference, Proceedings of the ACM on Human-Computer Interaction, 2018, 2 (CSCW), pp. 163
gro.hasfulltextNo Full Text
gro.griffith.authorWang, Can

Files in this item


There are no files associated with this item.

This item appears in the following Collection(s)

  • Journal articles
    Contains articles published by Griffith authors in scholarly journals.

Show simple item record