dc.contributor.author | Nguyen, Quoc Viet Hung | |
dc.contributor.author | Huynh, Huu Viet | |
dc.contributor.author | Nguyen, Thanh Tam | |
dc.contributor.author | Weidlich, Matthias | |
dc.contributor.author | Yin, Hongzhi | |
dc.contributor.author | Zhou, Xiaofang | |
dc.date.accessioned | 2020-04-23T05:03:07Z | |
dc.date.available | 2020-04-23T05:03:07Z | |
dc.date.issued | 2018 | |
dc.identifier.doi | 10.1109/icde.2018.00232 | |
dc.identifier.uri | http://hdl.handle.net/10072/393373 | |
dc.description.abstract | Crowdsourcing has been widely established as a means to enable human computation at large-scale, in particular for tasks that require manual labelling of large sets of data items. Answers obtained from heterogeneous crowd workers are aggregated to obtain a robust result. In this paper, we consider partial-agreement tasks that are common in many applications such as image tagging and document annotation, where items are assigned sets of labels. Going beyond the state-of-the-art, we propose a novel Bayesian nonparametric model to aggregate the partial-agreement answers in a generic way. This model enables us to compute the consensus of partially-sound and partially-complete worker answers, while taking into account mutual relations in labels and different answer sets. An evaluation of our method using real-world datasets reveals that it consistently outperforms the state-of-the-art in terms of precision, recall, and scalability. | |
dc.publisher | IEEE | |
dc.relation.ispartofconferencename | 2018 IEEE 34th International Conference on Data Engineering (ICDE) | |
dc.relation.ispartofconferencetitle | 2018 IEEE 34th International Conference on Data Engineering (ICDE) | |
dc.relation.ispartofdatefrom | 2018-04-16 | |
dc.relation.ispartofdateto | 2018-04-19 | |
dc.subject.fieldofresearch | Data management and data science | |
dc.subject.fieldofresearchcode | 4605 | |
dc.title | Computing Crowd Consensus with Partial Agreement | |
dc.type | Conference output | |
dc.type.description | E3 - Conferences (Extract Paper) | |
dcterms.bibliographicCitation | Nguyen, QVH; Huynh, HV; Nguyen, TT; Weidlich, M; Yin, H; Zhou, X, Computing Crowd Consensus with Partial Agreement, 2018 IEEE 34th International Conference on Data Engineering (ICDE), 2018 | |
dc.date.updated | 2020-04-23T05:00:13Z | |
gro.hasfulltext | No Full Text | |
gro.griffith.author | Nguyen, Henry | |
gro.griffith.author | Nguyen, Thanh Tam | |