dc.contributor.author | Nguyen, Quoc Viet Hung | |
dc.contributor.author | Duong, Chi Thang | |
dc.contributor.author | Weidlich, Matthias | |
dc.contributor.author | Aberer, Karl | |
dc.date.accessioned | 2017-10-16T05:18:42Z | |
dc.date.available | 2017-10-16T05:18:42Z | |
dc.date.issued | 2015 | |
dc.identifier.doi | 10.1145/2766462.2767866 | |
dc.identifier.uri | http://hdl.handle.net/10072/348096 | |
dc.description.abstract | Crowdsourcing became an essential tool for a broad range of Web applications. Yet, the wide-ranging levels of expertise of crowd workers as well as the presence of faulty workers call for quality control of the crowdsourcing result. To this end, many crowdsourcing platforms feature a post-processing phase, in which crowd answers are validated by experts. This approach incurs high costs though, since expert input is a scarce resource. To support the expert in the validation process, we present a tool for \emph{ExpeRt guidance In validating Crowd Answers (ERICA)}. It allows us to guide the expert's work by collecting input on the most problematic cases, thereby achieving a set of high quality answers even if the expert does not validate the complete answer set. The tool also supports the task requester in selecting the most cost-efficient allocation of the budget between the expert and the crowd. | |
dc.language | English | |
dc.publisher | Association for Computing Machinery (ACM) | |
dc.publisher.place | United States | |
dc.relation.ispartofconferencename | 38th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) | |
dc.relation.ispartofconferencetitle | SIGIR 2015: PROCEEDINGS OF THE 38TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL | |
dc.relation.ispartofdatefrom | 2015-08-09 | |
dc.relation.ispartofdateto | 2015-08-13 | |
dc.relation.ispartoflocation | Santiago, CHILE | |
dc.relation.ispartofpagefrom | 1037 | |
dc.relation.ispartofpageto | 1038 | |
dc.subject.fieldofresearch | Database systems | |
dc.subject.fieldofresearchcode | 460505 | |
dc.title | ERICA: Expert Guidance in Validating Crowd Answers | |
dc.type | Conference output | |
dc.type.description | E2 - Conferences (Non Refereed) | |
dc.type.code | E - Conference Publications | |
dc.description.version | Accepted Manuscript (AM) | |
gro.rights.copyright | © ACM, 2016. This is the author's version of the work. It is posted here by permission of ACM for your personal use. Not for redistribution. The definitive version was published in Proceedings of the 2016 ACM SIGMIS Conference on Computers and People Research, ISBN: 978-1-4503-4203-2, DOI: 10.1145/2890602.2890624 | |
gro.hasfulltext | Full Text | |
gro.griffith.author | Nguyen, Henry | |