Deep Bayesian Trust : A Dominant and Fair Incentive Mechanism for Crowd
This addresses the inefficiency of gold task assignment in large-scale crowdsourcing, offering a more scalable solution for platforms relying on crowd work.
The paper tackles the problem of efficiently eliciting high-quality work from crowds by proposing a novel incentive mechanism that assigns gold standard tasks to only a few workers and uses transitivity to infer the accuracy of others, ensuring dominant incentive compatibility and fairness.
An important class of game-theoretic incentive mechanisms for eliciting effort from a crowd are the peer based mechanisms, in which workers are paid by matching their answers with one another. The other classic mechanism is to have the workers solve some gold standard tasks and pay them according to their accuracy on gold tasks. This mechanism ensures stronger incentive compatibility than the peer based mechanisms but assigning gold tasks to all workers becomes inefficient at large scale. We propose a novel mechanism that assigns gold tasks to only a few workers and exploits transitivity to derive accuracy of the rest of the workers from their peers' accuracy. We show that the resulting mechanism ensures a dominant notion of incentive compatibility and fairness.