Understanding and estimating the power to detect cross-level interaction effects in multilevel modeling

The Journal of Applied Psychology
John E MathieuGilad Chen

Abstract

Cross-level interaction effects lie at the heart of multilevel contingency and interactionism theories. Researchers have often lamented the difficulty of finding hypothesized cross-level interactions, and to date there has been no means by which the statistical power of such tests can be evaluated. We develop such a method and report results of a large-scale simulation study, verify its accuracy, and provide evidence regarding the relative importance of factors that affect the power to detect cross-level interactions. Our results indicate that the statistical power to detect cross-level interactions is determined primarily by the magnitude of the cross-level interaction, the standard deviation of lower level slopes, and the lower and upper level sample sizes. We provide a Monte Carlo tool that enables researchers to a priori design more efficient multilevel studies and provides a means by which they can better interpret potential explanations for nonsignificant results. We conclude with recommendations for how scholars might design future multilevel studies that will lead to more accurate inferences regarding the presence of cross-level interactions.

Citations

Jan 11, 2016·Prevention Science : the Official Journal of the Society for Prevention Research·Celene E DomitrovichNicholas Ialongo
Jun 23, 2015·Human Brain Mapping·Aldo Córdova-PalomeraLourdes Fañanás
Sep 1, 2015·BMC Health Services Research·Henrik WåhlbergAnn Ragnhild Broderstad
Oct 24, 2013·Consciousness and Cognition·Giulia L PoerioEleanor Miles
Jun 10, 2016·Personality & Social Psychology Bulletin·Ursula HessCarolin-Louisa Kessler
Feb 28, 2018·Proceedings of the National Academy of Sciences of the United States of America·Neil Hester, Kurt Gray
Jul 15, 2018·Journal of Personality·John B NezlekMarzena Cypryańska
Sep 19, 2018·Personality & Social Psychology Bulletin·Samantha J Heintzelman, Laura A King
Mar 2, 2019·The Spanish Journal of Psychology·Vicente González-Romá
Mar 16, 2019·British Journal of Psychology·Isidro LandaTammy English
Sep 17, 2019·Public Understanding of Science·Brigitte HuberJames Liu
Jun 13, 2020·Alcoholism, Clinical and Experimental Research·Angela K StevensKristina M Jackson
Sep 24, 2020·Cognition & Emotion·Chelsea A ReidSandra Gramling
Jan 1, 2014·Health Psychology and Behavioral Medicine·Daryl B O'ConnorEamonn Ferguson
Mar 22, 2018·Frontiers in Psychology·Safâa AchnakTim Vantilborgh
Aug 22, 2018·Frontiers in Psychology·Rebecca A LundwallSteven P Tolboe
Sep 25, 2019·Self and Identity : the Journal of the International Society for Self and Identity·Bridget P LynchMichelle R vanDellen
Jan 30, 2020·Social Cognitive and Affective Neuroscience·Christian BellebaumPatrizia Thoma
Jun 17, 2020·British Journal of Psychology·Swantje MuellerDenis Gerstorf
Jun 6, 2019·Frontiers in Psychology·Denise Kerkhoff, Fridtjof W Nussbeck
Dec 19, 2019·Behavior Research Methods·Sunyoung Park, S Natasha Beretvas
Mar 30, 2020·Psychopharmacology·Kenneth A Perkins, Joshua L Karelitz
Dec 21, 2018·Frontiers in Psychology·Christiane R Stempel, Thomas Rigotti
May 21, 2019·Educational and Psychological Measurement·Chunhua CaoStephen Stark
Dec 2, 2020·European Journal of Pain : EJP·Silke RostDimitri M L Van Ryckeghem
Feb 17, 2021·Developmental Cognitive Neuroscience·Maureen E BowersNathan A Fox
Mar 27, 2021·Anxiety, Stress, and Coping·Sascha Abdel HadiJan A Häusser
Apr 10, 2021·Anxiety, Stress, and Coping·Ashley K RandallNicholas D Duran
Apr 22, 2021·Health Policy and Planning·Reajul ChowdhuryHeather Krause

❮ Previous
Next ❯

Related Concepts

Trending Feeds

COVID-19

Coronaviruses encompass a large family of viruses that cause the common cold as well as more serious diseases, such as the ongoing outbreak of coronavirus disease 2019 (COVID-19; formally known as 2019-nCoV). Coronaviruses can spread from animals to humans; symptoms include fever, cough, shortness of breath, and breathing difficulties; in more severe cases, infection can lead to death. This feed covers recent research on COVID-19.

Blastomycosis

Blastomycosis fungal infections spread through inhaling Blastomyces dermatitidis spores. Discover the latest research on blastomycosis fungal infections here.

Nuclear Pore Complex in ALS/FTD

Alterations in nucleocytoplasmic transport, controlled by the nuclear pore complex, may be involved in the pathomechanism underlying multiple neurodegenerative diseases including Amyotrophic Lateral Sclerosis and Frontotemporal Dementia. Here is the latest research on the nuclear pore complex in ALS and FTD.

Applications of Molecular Barcoding

The concept of molecular barcoding is that each original DNA or RNA molecule is attached to a unique sequence barcode. Sequence reads having different barcodes represent different original molecules, while sequence reads having the same barcode are results of PCR duplication from one original molecule. Discover the latest research on molecular barcoding here.

Chronic Fatigue Syndrome

Chronic fatigue syndrome is a disease characterized by unexplained disabling fatigue; the pathology of which is incompletely understood. Discover the latest research on chronic fatigue syndrome here.

Evolution of Pluripotency

Pluripotency refers to the ability of a cell to develop into three primary germ cell layers of the embryo. This feed focuses on the mechanisms that underlie the evolution of pluripotency. Here is the latest research.

Position Effect Variegation

Position Effect Variagation occurs when a gene is inactivated due to its positioning near heterochromatic regions within a chromosome. Discover the latest research on Position Effect Variagation here.

STING Receptor Agonists

Stimulator of IFN genes (STING) are a group of transmembrane proteins that are involved in the induction of type I interferon that is important in the innate immune response. The stimulation of STING has been an active area of research in the treatment of cancer and infectious diseases. Here is the latest research on STING receptor agonists.

Microbicide

Microbicides are products that can be applied to vaginal or rectal mucosal surfaces with the goal of preventing, or at least significantly reducing, the transmission of sexually transmitted infections. Here is the latest research on microbicides.