NIH peer review: Criterion scores completely account for racial disparities in overall impact scores

Science Advances
Elena A EroshevaCarole J Lee

Abstract

Previous research has found that funding disparities are driven by applications' final impact scores and that only a portion of the black/white funding gap can be explained by bibliometrics and topic choice. Using National Institutes of Health R01 applications for council years 2014-2016, we examine assigned reviewers' preliminary overall impact and criterion scores to evaluate whether racial disparities in impact scores can be explained by application and applicant characteristics. We hypothesize that differences in commensuration-the process of combining criterion scores into overall impact scores-disadvantage black applicants. Using multilevel models and matching on key variables including career stage, gender, and area of science, we find little evidence for racial disparities emerging in the process of combining preliminary criterion scores into preliminary overall impact scores. Instead, preliminary criterion scores fully account for racial disparities-yet do not explain all of the variability-in preliminary overall impact scores.

References

Mar 29, 2001·Psychological Science·J F Dovidio, S L Gaertner
Dec 16, 2004·Journal of Personality and Social Psychology·Michael I NortonJohn M Darley
Jun 10, 2005·Psychological Science·Ericluis Uhlmann, Geoffrey L Cohen
Sep 11, 2009·The American Psychologist·Daniel Kahneman, Gary Klein
Aug 20, 2011·Science·Lawrence A Tabak, Francis S Collins
Aug 20, 2011·Science·Donna K GintherRaynard Kington
Sep 29, 2012·Academic Medicine : Journal of the Association of American Medical Colleges·Donna K GintherRaynard Kington
Jul 16, 2014·Annals of Internal Medicine·Rachael L FleurenceJoseph V Selby
Jul 16, 2015·Journal of General Internal Medicine·Erica T WarnerJoan Y Reede
Sep 24, 2015·Proceedings of the National Academy of Sciences of the United States of America·Hannah A Valantine, Francis S Collins
May 31, 2016·The American Journal of Evaluation·Mark D LindnerGeorge Chacko
Jun 17, 2016·Academic Medicine : Journal of the Association of American Medical Colleges·Donna K GintherWalter T Schaffer
Oct 6, 2016·Royal Society Open Science·Paul E Smaldino, Richard McElreath
Nov 11, 2016·PLoS Biology·Andrew D Higginson, Marcus R Munafò
Apr 4, 2018·PloS One·Mark D LindnerNasim A Khan
Nov 15, 2018·PloS One·Donna K GintherWalter T Schaffer
Jan 1, 2018·Nature Human Behaviour·Daniel J BenjaminValen E Johnson
Oct 22, 2019·Science Advances·Travis A HoppeGeorge M Santangelo

❮ Previous
Next ❯

Citations

Sep 15, 2020·Molecular Biology of the Cell·Christina M Termini, Amara Pang
Sep 19, 2020·Science·Paul H BarberUNKNOWN 10,234 signatories
Oct 5, 2020·Lancet·Carole J LeeElena A Erosheva
Jan 28, 2021·Cell·Kelly R StevensOmolola Eniola-Adefeso
Dec 23, 2020·Nature Reviews. Neuroscience·Kaela S SingletonAngeline J Dukes
Mar 19, 2021·Science and Engineering Ethics·Stephen A GalloScott R Glisson
May 14, 2021·Molecular Biology of the Cell·Mark Peifer
Jul 6, 2021·Journal of Clinical and Translational Science·Kelsey S DicksonNicole A Stadnick
Oct 13, 2021·MSystems·Alicia J FoxxAdam R Rivers
Nov 16, 2021·The Journal of the American Academy of Orthopaedic Surgeons·Tamara A ScerpellaMolly L Carnes
Nov 26, 2021·Science·Sindy N Escobar AlvarezElizabeth R Myers
Sep 27, 2021·American Journal of Epidemiology·Paris B Adkins-JacksonNinez A Ponce
Dec 24, 2021·Molecular Biology of the Cell·Donna K Ginther

❮ Previous
Next ❯

Software Mentioned

IMPAC

Related Concepts

Trending Feeds

COVID-19

Coronaviruses encompass a large family of viruses that cause the common cold as well as more serious diseases, such as the ongoing outbreak of coronavirus disease 2019 (COVID-19; formally known as 2019-nCoV). Coronaviruses can spread from animals to humans; symptoms include fever, cough, shortness of breath, and breathing difficulties; in more severe cases, infection can lead to death. This feed covers recent research on COVID-19.

Blastomycosis

Blastomycosis fungal infections spread through inhaling Blastomyces dermatitidis spores. Discover the latest research on blastomycosis fungal infections here.

Nuclear Pore Complex in ALS/FTD

Alterations in nucleocytoplasmic transport, controlled by the nuclear pore complex, may be involved in the pathomechanism underlying multiple neurodegenerative diseases including Amyotrophic Lateral Sclerosis and Frontotemporal Dementia. Here is the latest research on the nuclear pore complex in ALS and FTD.

Applications of Molecular Barcoding

The concept of molecular barcoding is that each original DNA or RNA molecule is attached to a unique sequence barcode. Sequence reads having different barcodes represent different original molecules, while sequence reads having the same barcode are results of PCR duplication from one original molecule. Discover the latest research on molecular barcoding here.

Chronic Fatigue Syndrome

Chronic fatigue syndrome is a disease characterized by unexplained disabling fatigue; the pathology of which is incompletely understood. Discover the latest research on chronic fatigue syndrome here.

Evolution of Pluripotency

Pluripotency refers to the ability of a cell to develop into three primary germ cell layers of the embryo. This feed focuses on the mechanisms that underlie the evolution of pluripotency. Here is the latest research.

Position Effect Variegation

Position Effect Variagation occurs when a gene is inactivated due to its positioning near heterochromatic regions within a chromosome. Discover the latest research on Position Effect Variagation here.

STING Receptor Agonists

Stimulator of IFN genes (STING) are a group of transmembrane proteins that are involved in the induction of type I interferon that is important in the innate immune response. The stimulation of STING has been an active area of research in the treatment of cancer and infectious diseases. Here is the latest research on STING receptor agonists.

Microbicide

Microbicides are products that can be applied to vaginal or rectal mucosal surfaces with the goal of preventing, or at least significantly reducing, the transmission of sexually transmitted infections. Here is the latest research on microbicides.