Iterative Aggregation of Crowdsourced Tasks Within the Belief Function Theory (original) (raw)

Lecture Notes in Computer Science, 2017

Abstract

With the growing of crowdsourcing services, gathering training data for supervised machine learning has become cheaper and faster than engaging experts. However, the quality of the crowd-generated labels remains an open issue. This is basically due to the wide ranging expertise levels of the participants in the labeling process. In this paper, we present an iterative approach of label aggregation based on the belief function theory that simultanously estimates labels, the reliability of participants and difficulty of each task. Our empirical evaluation demonstrate the efficiency of our method as it gives better quality labels.

Imen Boukhris hasn't uploaded this paper.

Let Imen know you want this paper to be uploaded.

Ask for this paper to be uploaded.