Options
Can Laymen Outperform Experts? The Effects of User Expertise and Task Design in Crowdsourced Software Testing
Type
conference paper
Date Issued
2016-06
Author(s)
Research Team
IWI6, CCC, Crowdsourcing
Abstract
In recent years, crowdsourcing has increasingly gained attention as a powerful sourcing mechanism for problem-solving in organizations. Depending on the type of activity addressed by crowdsourcing, the complexity of the tasks and the role of the crowdworkers may differ substantially. It is crucial that the tasks are designed and allocated according to the capabilities of the targeted crowds. In this paper, we outline our research in progress which is concerned with the effects of task complexity and user expertise on performance in crowdsourced software testing. We conduct an experiment and gather empirical data from expert and novice crowds that perform different software testing tasks of varying degrees of complexity. Our expected contribution is twofold. For crowdsourcing in general, we aim at providing valuable insights for the process of framing and allocating tasks to crowds in ways that increase the crowdworkers’
performance. Secondly, we intend to improve the configuration of crowdsourced software testing initiatives. More precisely, the results are expected to show practitioners what types of testing tasks should be assigned to which group of dedicated crowdworkers. In this vein, we deliver valuable decision support for both crowdsourcers and intermediaries to enhance the performance of their crowdsourcing initiatives.
performance. Secondly, we intend to improve the configuration of crowdsourced software testing initiatives. More precisely, the results are expected to show practitioners what types of testing tasks should be assigned to which group of dedicated crowdworkers. In this vein, we deliver valuable decision support for both crowdsourcers and intermediaries to enhance the performance of their crowdsourcing initiatives.
Language
English
Keywords
Complexity
Crowdsourcing
Expertise
Performance Software Testing
HSG Classification
contribution to practical use / society
HSG Profile Area
SoM - Business Innovation
Book title
Information systems as a global gateway : 24th European Conference on Information Systems
Publisher
Boğaziçi University
Publisher place
Istanbul
Event Title
24th European Conference on Information Systems (ECIS) 2016
Event Location
Istanbul, Turkey
Event Date
12.-15.06.2016
Official URL
Subject(s)
Division(s)
Eprints ID
248349