PSYCHOLOGY. Estimating the reproducibility of psychological science

Science
Open Science Collaboration

Abstract

Reproducibility is a defining feature of science, but the extent to which it characterizes current research is unknown. We conducted replications of 100 experimental and correlational studies published in three psychology journals using high-powered designs and original materials when available. Replication effects were half the magnitude of original effects, representing a substantial decline. Ninety-seven percent of original studies had statistically significant results. Thirty-six percent of replications had statistically significant results; 47% of original effect sizes were in the 95% confidence interval of the replication effect size; 39% of effects were subjectively rated to have replicated the original result; and if no bias in original results is assumed, combining original and replication results left 68% with statistically significant effects. Correlational tests suggest that replication success was better predicted by the strength of original evidence than by characteristics of the original and replication teams.

References

Sep 1, 1962·Journal of Abnormal and Social Psychology·J COHEN
Aug 3, 2005·PLoS Medicine·John P A Ioannidis
Aug 30, 2008·Journal of Personality and Social Psychology·Dolores AlbarracínWilliam P Hart
Sep 6, 2011·Nature Reviews. Drug Discovery·Florian PrinzKhusru Asadullah
Mar 10, 2012·Frontiers in Computational Neuroscience·Joshua K Hartshorne, Adena Schachner
Mar 31, 2012·Nature·C Glenn Begley, Lee M Ellis
Apr 18, 2012·Psychological Science·Leslie K JohnDrazen Prelec
Apr 11, 2013·Nature Reviews. Neuroscience·Katherine S ButtonMarcus R Munafò
Nov 14, 2013·Psychological Science·Geoff Cumming
Jan 18, 2014·Science·Marcia McNutt
Mar 25, 2014·Trends in Cognitive Sciences·John P A IoannidisSean P David
Dec 11, 2014·ELife·Timothy M ErringtonBrian A Nosek
Mar 25, 2015·Psychological Science·Uri Simonsohn
Jun 9, 2015·Frontiers in Psychology·Rosario Cabello, Pablo Fernández-Berrocal
Jun 27, 2015·Science·B A NosekT Yarkoni
Jul 1, 2009·Perspectives on Psychological Science : a Journal of the Association for Psychological Science·Paul Rozin
Nov 1, 2012·Perspectives on Psychological Science : a Journal of the Association for Psychological Science·Harold Pashler, Eric-Jan Wagenmakers
Nov 1, 2012·Perspectives on Psychological Science : a Journal of the Association for Psychological Science·Brian A NosekMatt Motyl
Nov 1, 2012·Perspectives on Psychological Science : a Journal of the Association for Psychological Science
May 1, 2014·Perspectives on Psychological Science : a Journal of the Association for Psychological Science·Sanford L BraverRobert Rosenthal

❮ Previous
Next ❯

Citations

Feb 18, 2016·Behavioral Sciences & the Law·Lakin AndersonHarlene Hayne
Nov 21, 2015·The Gerontologist·Rachel PruchnoJohn B Williamson
Nov 27, 2015·Expert Review of Respiratory Medicine·Jasper V Been, Aziz Sheikh
Jan 26, 2016·Biopreservation and Biobanking·Sara Y NussbeckRita T Lawlor
Feb 18, 2016·Journal of Pharmaceutical Sciences·Steve Elliott
Feb 6, 2016·American Journal of Primatology·Darcy L HannibalJohn Capitanio
Feb 10, 2016·Frontiers in Psychology·Paul Zhihao Yong, Stephen Wee Hun Lim
Feb 13, 2016·Frontiers in Neuroinformatics·Mary K AskrenTara M Madhyastha
Jan 7, 2016·Journal of Psychiatric Research·Joseph F McGuireEric A Storch
Jan 29, 2016·Nature Methods·Lewis G HalseyGordon B Drummond
Jan 26, 2016·Wiley Interdisciplinary Reviews. Cognitive Science·Rick O Gilmore
Jan 10, 2016·Neuroscience and Biobehavioral Reviews·Sarah W Feldstein EwingBrooke S G Molina
Jan 16, 2016·Acta Psychiatrica Scandinavica·I Hageman
Jan 19, 2016·Trends in Biotechnology·Claes Gustafsson, Jordi Vallverdú
Jan 19, 2016·Trends in Pharmacological Sciences·Michael F Jarvis, Michael Williams
Jan 19, 2016·Medicina clínica·Rafael Dal-RéRafael Garesse
Mar 15, 2016·Frontiers in Psychology·Chandramallika Basak, Margaret A O'Connell
Dec 4, 2015·Proceedings of the National Academy of Sciences of the United States of America·Alec Brandon, John A List
Nov 11, 2015·Proceedings of the National Academy of Sciences of the United States of America·Anna DreberMagnus Johannesson
Mar 5, 2016·Science·Daniel T GilbertTimothy D Wilson
Mar 5, 2016·Science·Christopher J AndersonKellylynn Zuni
Mar 5, 2016·Science·Colin F CamererHang Wu
Dec 18, 2015·Journal of the Experimental Analysis of Behavior·Amy L Odum
Dec 15, 2015·Cyberpsychology, Behavior and Social Networking·Svitlana Volkova, Yoram Bachrach
Dec 9, 2015·Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences·Mark Nielsen, Daniel Haun
Nov 26, 2015·Frontiers in Psychology·Ivan Ropovik
Nov 18, 2015·Analytical Chemistry·Jonathan V Sweedler
Mar 17, 2016·BMC Medicine·Stuart G NichollsDavid Moher
Mar 20, 2016·Behavior Genetics·Ziada AyorechRobert Plomin
Mar 26, 2016·Science·Benedikt Fecher, Gert G Wagner
Mar 26, 2016·Science·Kurt LejaeghereStefaan Cottenier
Mar 28, 2016·Brain : a Journal of Neurology·Marzia De Lucia, Athina Tzovara
Mar 29, 2016·Translational Stroke Research·Thomas A Kent, Pitchaiah Mandava
Apr 12, 2016·Frontiers in Neural Circuits·Tzvetomir Tzvetanov
May 6, 2016·Frontiers in Human Neuroscience·David MoreauKaren E Waldie
Apr 14, 2016·Obesity Reviews : an Official Journal of the International Association for the Study of Obesity·S C LemonS L Pagoto
Apr 14, 2016·Psychonomic Bulletin & Review·Richard Kunert
May 21, 2016·Frontiers in Psychology·Vanessa V SochatRussell A Poldrack

❮ Previous
Next ❯

Related Concepts

Trending Feeds

COVID-19

Coronaviruses encompass a large family of viruses that cause the common cold as well as more serious diseases, such as the ongoing outbreak of coronavirus disease 2019 (COVID-19; formally known as 2019-nCoV). Coronaviruses can spread from animals to humans; symptoms include fever, cough, shortness of breath, and breathing difficulties; in more severe cases, infection can lead to death. This feed covers recent research on COVID-19.

Blastomycosis

Blastomycosis fungal infections spread through inhaling Blastomyces dermatitidis spores. Discover the latest research on blastomycosis fungal infections here.

Nuclear Pore Complex in ALS/FTD

Alterations in nucleocytoplasmic transport, controlled by the nuclear pore complex, may be involved in the pathomechanism underlying multiple neurodegenerative diseases including Amyotrophic Lateral Sclerosis and Frontotemporal Dementia. Here is the latest research on the nuclear pore complex in ALS and FTD.

Applications of Molecular Barcoding

The concept of molecular barcoding is that each original DNA or RNA molecule is attached to a unique sequence barcode. Sequence reads having different barcodes represent different original molecules, while sequence reads having the same barcode are results of PCR duplication from one original molecule. Discover the latest research on molecular barcoding here.

Chronic Fatigue Syndrome

Chronic fatigue syndrome is a disease characterized by unexplained disabling fatigue; the pathology of which is incompletely understood. Discover the latest research on chronic fatigue syndrome here.

Evolution of Pluripotency

Pluripotency refers to the ability of a cell to develop into three primary germ cell layers of the embryo. This feed focuses on the mechanisms that underlie the evolution of pluripotency. Here is the latest research.

Position Effect Variegation

Position Effect Variagation occurs when a gene is inactivated due to its positioning near heterochromatic regions within a chromosome. Discover the latest research on Position Effect Variagation here.

STING Receptor Agonists

Stimulator of IFN genes (STING) are a group of transmembrane proteins that are involved in the induction of type I interferon that is important in the innate immune response. The stimulation of STING has been an active area of research in the treatment of cancer and infectious diseases. Here is the latest research on STING receptor agonists.

Microbicide

Microbicides are products that can be applied to vaginal or rectal mucosal surfaces with the goal of preventing, or at least significantly reducing, the transmission of sexually transmitted infections. Here is the latest research on microbicides.

Related Papers

Perspectives on Psychological Science : a Journal of the Association for Psychological Science
Matthew C MakelBoyd Hegarty
Perspectives on Psychological Science : a Journal of the Association for Psychological Science
Journal of the Association of Pediatric Oncology Nurses
C L Walker
International Journal of Sports Physiology and Performance
Dennis-Peter BornHans-Christer Holmberg
© 2021 Meta ULC. All rights reserved