Reputation Management in Crowdsourcing Systems

Mohammad Allahbakhsh; Aleksandar Ignjatovic; Boualem Benatallah; Seyed-Mehdi-Reza Beheshti; Elisa Bertino; Norman Foo

7th IEEE International Workshop on Trusted Collaboration

Research Article

Reputation Management in Crowdsourcing Systems

Download1047 downloads

Cite: BibTeX Plain Text

@INPROCEEDINGS{10.4108/icst.collaboratecom.2012.250499,
    author={Mohammad Allahbakhsh and Aleksandar Ignjatovic and Boualem Benatallah and Seyed-Mehdi-Reza Beheshti and Elisa Bertino and Norman Foo},
    title={Reputation Management in Crowdsourcing Systems},
    proceedings={7th IEEE International Workshop on Trusted Collaboration},
    publisher={IEEE},
    proceedings_a={TRUSTCOL},
    year={2012},
    month={12},
    keywords={reputation degree of fairness crowdsourcing},
    doi={10.4108/icst.collaboratecom.2012.250499}
}

Mohammad Allahbakhsh
Aleksandar Ignjatovic
Boualem Benatallah
Seyed-Mehdi-Reza Beheshti
Elisa Bertino
Norman Foo
Year: 2012
Reputation Management in Crowdsourcing Systems
TRUSTCOL
ICST
DOI: 10.4108/icst.collaboratecom.2012.250499

Mohammad Allahbakhsh¹^,*, Aleksandar Ignjatovic¹, Boualem Benatallah¹, Seyed-Mehdi-Reza Beheshti¹, Elisa Bertino², Norman Foo¹

1: UNSW
2: Purdue University

*Contact email: mallahbakhsh@cse.unsw.edu.au

Abstract

Worker selection is a significant and challenging issue in crowdsourcing systems. Such selection is usually based on an assessment of the reputation of the individual workers participating in such systems. However, assessing the credibility and adequacy of such calculated reputation is a real challenge.

In this paper, we propose a reputation management model which leverages the values of the tasks completed, the credibility of the evaluators of the results of the tasks and time of evaluation of the results of these tasks in order to calculate more dependable quality metrics for workers and evaluators. The model has been implemented and experimentally validated.

Keywords: reputation degree of fairness crowdsourcing

Published: 2012-12-14
Publisher: IEEE

: http://dx.doi.org/10.4108/icst.collaboratecom.2012.250499