Trustworthiness in Enterprise Crowdsourcing: a Taxonomy & evidence from data
This provides guidelines for enterprise software development using crowdsourcing, but it is incremental as it synthesizes existing knowledge with new data analysis.
The paper tackled the problem of trustworthiness in crowdsourced software development by analyzing risks, mitigation techniques, and empirical data from two vendors, presenting metrics on untrustworthy behavior and technique performance.
In this paper we study the trustworthiness of the crowd for crowdsourced software development. Through the study of literature from various domains, we present the risks that impact the trustworthiness in an enterprise context. We survey known techniques to mitigate these risks. We also analyze key metrics from multiple years of empirical data of actual crowdsourced software development tasks from two leading vendors. We present the metrics around untrustworthy behavior and the performance of certain mitigation techniques. Our study and results can serve as guidelines for crowdsourced enterprise software development.