Mechanical Turk data collection in addiction research: utility, concerns and best practices.

Addiction
Alexandra M Mellis, Warren K Bickel

Abstract

Amazon Mechanical Turk (MTurk) provides a crowdsourcing platform for the engagement of potential research participants with data collection instruments. This review (1) provides an introduction to the mechanics and validity of MTurk research; (2) gives examples of MTurk research; and (3) discusses current limitations and best practices in MTurk research. We review four use cases of MTurk for research relevant to addictions: (1) the development of novel measures, (2) testing interventions, (3) the collection of longitudinal use data to determine the feasibility of longer-term studies of substance use and (4) the completion of large batteries of assessments to characterize the relationships between measured constructs. We review concerns with the platform, ways of mitigating these and important information to include when presenting findings. MTurk has proved to be a useful source of data for behavioral science more broadly, with specific applications to addiction science. However, it is still not appropriate for all use cases, such as population-level inference. To live up to the potential of highly transparent, reproducible science from MTurk, researchers should clearly report inclusion/exclusion criteria, data quality checks a...Continue Reading

References

Jun 11, 2008·Experimental and Clinical Psychopharmacology·Matthew W Johnson, Warren K Bickel
Mar 5, 2011·Psychopharmacology·James MacKillopMarcus R Munafò
Jul 1, 2011·Behavior Research Methods·Winter Mason, Siddharth Suri
Jul 26, 2012·Psychonomic Bulletin & Review·Laura GermineJeremy B Wilmer
Mar 22, 2013·PloS One·Matthew J C CrumpTodd M Gureckis
Jul 10, 2013·Behavior Research Methods·Jesse ChandlerGabriele Paolacci
Dec 21, 2013·Behavior Research Methods·Eyal PeerAlessandro Acquisti
Nov 6, 2014·Journal of Thoracic Oncology : Official Publication of the International Association for the Study of Lung Cancer·Conor E SteuerSuresh S Ramalingam
Nov 13, 2014·Journal of the Experimental Analysis of Behavior·Patrick S JohnsonMatthew W Johnson
Jul 7, 2015·Experimental and Clinical Psychopharmacology·Jeffrey S SteinWarren K Bickel
Jan 1, 2011·Perspectives on Psychological Science : a Journal of the Association for Psychological Science·Michael BuhrmesterSamuel D Gosling
Jun 2, 2016·Alcoholism, Clinical and Experimental Research·Sarah E SniderWarren K Bickel
Aug 25, 2016·Psychopharmacology·Jeffrey S SteinWarren K Bickel
Oct 27, 2017·Behaviour Research and Therapy·Ian W EisenbergRussell A Poldrack
Jan 6, 2018·Journal of General Internal Medicine·Karoline Mortensen, Taylor L Hughes
May 4, 2018·JMIR Public Health and Surveillance·Jacob T BorodovskyAlan J Budney
Jun 7, 2018·Journal of the Experimental Analysis of Behavior·Justin C Strickland, William W Stoops
Aug 24, 2018·Internet Interventions : the Application of Information Technology in Mental and Behavioural Health·John A CunninghamVladyslav Kushnir
Nov 30, 2018·Experimental and Clinical Psychopharmacology·Justin C Strickland, William W Stoops
Mar 8, 2019·Proceedings of the National Academy of Sciences of the United States of America·A Zeynep EnkaviRussell A Poldrack
Sep 13, 2019·Behavior Research Methods·Jesse ChandlerLeib Litman

❮ Previous
Next ❯

Citations

May 31, 2020·Alcoholism, Clinical and Experimental Research·Samuel F AcuffJames G Murphy
Oct 30, 2020·Substance Use & Misuse·Jessica YingstAndrea L Hobkirk
Jan 12, 2021·PloS One·Victoria M E BridglandMelanie K T Takarangi
Jan 26, 2021·Drug and Alcohol Review·Samantha M RundleChristian S Hendershot
Jan 20, 2021·Drug and Alcohol Dependence·Samuel F AcuffJustin C Strickland
Nov 17, 2020·Frontiers in Psychiatry·Matthew D McPheeChristian S Hendershot
Jan 6, 2021·International Journal of Environmental Research and Public Health·Jessica M YingstJonathan Foulds
Mar 4, 2021·Journal of Clinical Child and Adolescent Psychology : the Official Journal for the Society of Clinical Child and Adolescent Psychology, American Psychological Association, Division 53·Diana M Y SmithKathryn R Fox
May 4, 2021·Psychological Reports·Kirstie M Herb NeffKaren K Saules
May 20, 2021·Substance Abuse : Official Publication of the Association for Medical Education and Research in Substance Abuse·Michael FendrichMorica Hutchison
May 7, 2021·Nicotine & Tobacco Research : Official Journal of the Society for Research on Nicotine and Tobacco·Roberta Freitas-LemosWarren K Bickel
Aug 3, 2021·Drug and Alcohol Dependence·Erin FergusonJeff Boissoneault

❮ Previous
Next ❯

Related Concepts

Trending Feeds

COVID-19

Coronaviruses encompass a large family of viruses that cause the common cold as well as more serious diseases, such as the ongoing outbreak of coronavirus disease 2019 (COVID-19; formally known as 2019-nCoV). Coronaviruses can spread from animals to humans; symptoms include fever, cough, shortness of breath, and breathing difficulties; in more severe cases, infection can lead to death. This feed covers recent research on COVID-19.

Blastomycosis

Blastomycosis fungal infections spread through inhaling Blastomyces dermatitidis spores. Discover the latest research on blastomycosis fungal infections here.

Nuclear Pore Complex in ALS/FTD

Alterations in nucleocytoplasmic transport, controlled by the nuclear pore complex, may be involved in the pathomechanism underlying multiple neurodegenerative diseases including Amyotrophic Lateral Sclerosis and Frontotemporal Dementia. Here is the latest research on the nuclear pore complex in ALS and FTD.

Applications of Molecular Barcoding

The concept of molecular barcoding is that each original DNA or RNA molecule is attached to a unique sequence barcode. Sequence reads having different barcodes represent different original molecules, while sequence reads having the same barcode are results of PCR duplication from one original molecule. Discover the latest research on molecular barcoding here.

Chronic Fatigue Syndrome

Chronic fatigue syndrome is a disease characterized by unexplained disabling fatigue; the pathology of which is incompletely understood. Discover the latest research on chronic fatigue syndrome here.

Evolution of Pluripotency

Pluripotency refers to the ability of a cell to develop into three primary germ cell layers of the embryo. This feed focuses on the mechanisms that underlie the evolution of pluripotency. Here is the latest research.

Position Effect Variegation

Position Effect Variagation occurs when a gene is inactivated due to its positioning near heterochromatic regions within a chromosome. Discover the latest research on Position Effect Variagation here.

STING Receptor Agonists

Stimulator of IFN genes (STING) are a group of transmembrane proteins that are involved in the induction of type I interferon that is important in the innate immune response. The stimulation of STING has been an active area of research in the treatment of cancer and infectious diseases. Here is the latest research on STING receptor agonists.

Microbicide

Microbicides are products that can be applied to vaginal or rectal mucosal surfaces with the goal of preventing, or at least significantly reducing, the transmission of sexually transmitted infections. Here is the latest research on microbicides.