Understanding the complementary nature of paid and volunteer crowds for content creation
DOI:
https://doi.org/10.47756/aihc.y5i1.65Keywords:
Crowdsourcing, Social Good, Wikipedia, Content CreationAbstract
Crowdsourced content creation like articles or slogans can be powered by crowds of volunteers or workers from paid task markets. Volunteers often have expertise and are intrinsically motivated, but are a limited resource, and are not always reliably available. On the other hand, paid crowd workers are reliably available, can be guided to produce high-quality content, but cost money. How can these different populations of crowd workers be leveraged together to power cost-effective yet high-quality crowd-powered content-creation systems? To answer this question, we need to understand the strengths and weaknesses of each. We conducted an online study where we hired paid crowd workers and recruited volunteers from social media to complete three content creation tasks for three real-world non-profit organizations that focus on empowering women. These tasks ranged in complexity from simply generating keywords or slogans to creating a draft biographical article. Our results show that paid crowds completed work and structured content following editorial guidelines more effectively. However, volunteer crowds provide content that is more original. Based on the findings, we suggest that crowd-powered content-creation systems could gain the best of both worlds by leveraging volunteers to scaffold the direction that original content should take; while having paid crowd workers structure content and prepare it for real world use.
Downloads
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2020 Claudia Flores-Saviaga, Ricardo Granados, Liliana Savage, Lizbeth Escobedo, Saiph Savage
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
AMexIHC make every effort to ensure the accuracy and rigour of all the information (the "Content") contained in out publications. However, AMexIHC and our representatives make no representations or warranties whatsoever as to the accuracy, completeness, or suitability for any purpose of the Content. Any opinions and views expressed in this publication are the opinions and views of the authors, and are not the views of or endorsed by AMexIHC. The accuracy of the Content should not be relied upon and should be independently verified with primary sources of information.