Title:
|
Worker ranking determination in crowdsourcing platforms using aggregation functions
|
Author:
|
Sanchez Charles, David; Nin Guerrero, Jordi; Solé Simó, Marc; Muntés Mulero, Victor
|
Other authors:
|
Universitat Politècnica de Catalunya. Departament d'Arquitectura de Computadors; Universitat Politècnica de Catalunya. CAP - Grup de Computació d'Altes Prestacions |
Abstract:
|
The increasing adoption of crowdsourcing for commercial and industrial purposes rises the need for creating sophisticated mechanisms in crowd-based digital platforms for efficient worker management. One of the main challenges in this area is worker motivation and skill set control and its impact on the output quality. The quality delivered by the workers in the crowd depends on different aspects such as their skills, experience, commitment, etc. The lack of generic and detailed proposals to incentive workers and the need for creating ad-hoc solutions depending on the domain make it difficult to evaluate the best rewarding functions in each scenario. In this paper, we make a step further in this direction and propose the use of aggregation functions to evaluate the professional skills of crowd-workers based on the quality of their past tasks. Additionally, we present a real industrial crowdsourcing solution for software localisation in which the proposed solutions are put into practice with real text translations quality measures. |
Abstract:
|
Peer Reviewed |
Subject(s):
|
-Àrees temàtiques de la UPC::Economia i organització d'empreses::Gestió de la qualitat -Àrees temàtiques de la UPC::Informàtica::Aplicacions de la informàtica -Quality control -- Mathematical models -Function evaluation -Human resource management -Aggregation functions -Crowdsourcing -Crowdsourcing platforms -Digital platforms -Output quality -Professional skills -Quality measures -Sophisticated mechanism -Control de qualitat -- Models matemàtics |
Rights:
|
|
Document type:
|
Article - Submitted version Conference Object |
Published by:
|
Institute of Electrical and Electronics Engineers (IEEE)
|
Share:
|
|