Amazon's Mechanical Turk: A New Source of Inexpensive, Yet High-Quality, Data? - PubMed (original) (raw)
Amazon's Mechanical Turk: A New Source of Inexpensive, Yet High-Quality, Data?
Michael Buhrmester et al. Perspect Psychol Sci. 2011 Jan.
Abstract
Amazon's Mechanical Turk (MTurk) is a relatively new website that contains the major elements required to conduct research: an integrated participant compensation system; a large participant pool; and a streamlined process of study design, participant recruitment, and data collection. In this article, we describe and evaluate the potential contributions of MTurk to psychology and other social sciences. Findings indicate that (a) MTurk participants are slightly more demographically diverse than are standard Internet samples and are significantly more diverse than typical American college samples; (b) participation is affected by compensation rate and task length, but participants can still be recruited rapidly and inexpensively; (c) realistic compensation rates do not affect data quality; and (d) the data obtained are at least as reliable as those obtained via traditional methods. Overall, MTurk can be used to obtain high-quality data inexpensively and rapidly.
Keywords: Amazon Mechanical Turk; Internet; data collection; online; research methods; web.
© The Author(s) 2011.
Similar articles
- Attentive Turkers: MTurk participants perform better on online attention checks than do subject pool participants.
Hauser DJ, Schwarz N. Hauser DJ, et al. Behav Res Methods. 2016 Mar;48(1):400-7. doi: 10.3758/s13428-015-0578-z. Behav Res Methods. 2016. PMID: 25761395 - An Evaluation of Amazon's Mechanical Turk, Its Rapid Rise, and Its Effective Use.
Buhrmester MD, Talaifar S, Gosling SD. Buhrmester MD, et al. Perspect Psychol Sci. 2018 Mar;13(2):149-154. doi: 10.1177/1745691617706516. Perspect Psychol Sci. 2018. PMID: 29928846 - Pseudo-dyadic "interaction" on Amazon's Mechanical Turk.
Summerville A, Chartier CR. Summerville A, et al. Behav Res Methods. 2013 Mar;45(1):116-24. doi: 10.3758/s13428-012-0250-9. Behav Res Methods. 2013. PMID: 23055159 Clinical Trial. - Comparing Amazon's Mechanical Turk Platform to Conventional Data Collection Methods in the Health and Medical Research Literature.
Mortensen K, Hughes TL. Mortensen K, et al. J Gen Intern Med. 2018 Apr;33(4):533-538. doi: 10.1007/s11606-017-4246-0. Epub 2018 Jan 4. J Gen Intern Med. 2018. PMID: 29302882 Free PMC article. Review. - Conducting Clinical Research Using Crowdsourced Convenience Samples.
Chandler J, Shapiro D. Chandler J, et al. Annu Rev Clin Psychol. 2016;12:53-81. doi: 10.1146/annurev-clinpsy-021815-093623. Epub 2016 Jan 11. Annu Rev Clin Psychol. 2016. PMID: 26772208 Review.
Cited by
- Potentially traumatic events, posttraumatic stress symptoms, and skin-related quality of life among adults with self-reported skin disease symptoms.
Strange TA, Clark HL, Dixon LJ. Strange TA, et al. Arch Dermatol Res. 2024 Nov 15;317(1):19. doi: 10.1007/s00403-024-03451-w. Arch Dermatol Res. 2024. PMID: 39546010 Free PMC article. - Morally Injurious Events and Depression: Examining the Role of Rumination Among Combat-Deployed Military Veterans in the Community.
Thomas ED, Weiss NH, Forkus SR, Contractor AA. Thomas ED, et al. Int J Stress Manag. 2024 May;31(2):162-166. doi: 10.1037/str0000319. Epub 2024 Jan 1. Int J Stress Manag. 2024. PMID: 39479368 - The Big, the Dark, and the Biopsychosocial Shades of Harmony: Personality Traits and Harmony in Life.
Garcia D. Garcia D. Behav Sci (Basel). 2024 Sep 27;14(10):873. doi: 10.3390/bs14100873. Behav Sci (Basel). 2024. PMID: 39457745 Free PMC article. - Exploring Food Preferences as a Pre-Step for Developing Diabetes-Friendly Options in Adults with Diabetes and Prediabetes.
Choi S, Choi J. Choi S, et al. Foods. 2024 Oct 16;13(20):3276. doi: 10.3390/foods13203276. Foods. 2024. PMID: 39456338 Free PMC article. - Understanding tourists' ambassador role of their origin places from perspective of residents' attitudes towards tourists.
Bi J, Gu C. Bi J, et al. Sci Rep. 2024 Oct 24;14(1):25164. doi: 10.1038/s41598-024-74688-8. Sci Rep. 2024. PMID: 39448686 Free PMC article.
LinkOut - more resources
Full Text Sources
Other Literature Sources