Interaction effects are very common in psychological research, but they are typically hard to replicate. A suspected reason for this is measurement error. Because of the poor replicability, a common recommendation is to not model interactions. 🧵
Don van Ravenzwaaij
@donvanraven.bsky.social
Professor @University of Groningen, Bayesian Inference, computational methods, reproducibility. Editor in Chief@Collabra: Psychology. Father of two, loves chess
Collabra: Psychology, the official journal of the Society for the Improvement of Psychological Science, seeks applications for Editor-in-Chief! The SIPS Publications Committee encourages editors with innovative ideas about how Collabra: Psychology can best accomplish its mission to apply.
🚀 Apply to become the new Editor in Chief at Collabra: Psychology, a mission-driven Open Access journal.🚀 Our blog posts describe the responsibilities of this role, the journal, and the application process. Please submit application materials by June 30th, 2026. #PsychSciSky
Collabra: Psychology seeks applications for Editor-in-Chief
Collabra: Psychology, the official journal of the Society for the Improvement of Psychological Science, is a mission-driven Open Access (OA) journal from the University of California Press that sha…
buff.ly
A new paper for my PhD has been published! In psychology, the default for studying the ubiquitous explanation ‘it-depends’ is the use of an interaction/moderator. This default creates tension between theory and model, yielding false positives and negatives. doi.org/10.1007/s421...
Anything Goes: Statistical Interactions Without Substantive Theory - Computational Brain & Behavior
Conditional effects, or interaction effects, do not imply multiplicative effects. However, product terms are the default method for modeling such conditional effects in psychological research. As a result, theoretically plausible conditional effects may go undetected when the functional form is misspecified. Our study had two objectives: (1) evaluate the extent to which non-linear phenomena can be identified as spurious multiplicative (i.e., standard) interaction terms in linear models, (2) assess how well linear models capture stepwise conditional effects. In Study 1, we examined spurious interactions from non-linear main effects. We found that traditional interaction terms were associated with increased Type-I error rates and small effect sizes. Importantly, this was also the case when the predictors were uncorrelated, indicating a mechanism beyond collinearity. Additionally, we found that, if captured, the spurious interaction effects did reduce prediction error on the population level. In Study 2, we simulated genuine conditional effects, following a stepwise pattern. When effects were monotonic, product terms performed adequately, however if the conditional effect is non-monotonic a traditional interaction term in a linear model does not sufficiently capture such an effect. We conclude that relying solely on traditional interaction terms in linear models can be misleading and the failure to replicate interaction effects may partly reflect a specification crisis: Researchers default to one functional form (multiplication) while the underlying theory may dictate a different form, creating a systematic mismatch between theory and model. To validly investigate conditional effects, researchers should specify and justify the expected functional form a priori.
doi.org
Collabra: Psychology is seeking a new senior editor for the clinical section and new associate editors for the social section. If you are interested in either of these positions and you believe you are qualified, please fill out the application form before 30 April 2026! forms.gle/DgM3484SuLVD...
Application Form Senior Editor Clinical/Associate Editor Social Section Collabra: Psychology
Starting from 1 July 2026, Collabra: Psychology is on the look-out for a new senior editor for the clinical section as well as several new associate editors for the social section. If you are interest...
forms.gle
📄Published Today in Nature: 500 researchers reproduced 100 studies across the social & behavioral sciences to assess their analytical robustness (led by @balazsaczel.bsky.social & @szaszibarnabas.bsky.social). Article: www.nature.com/articles/s41... Preprint: osf.io/preprints/me... TLDR: 1/11
🚨 Call for Editors: Join the Collabra: Psychology team! We're looking for a senior editor for clinical psychology, plus several social psychology associate editors. Interested? Please fill out our application form before 30 April 2026. @improvingpsych.org docs.google.com/forms/d/e/1F...
Application Form Senior Editor Clinical/Associate Editor Social Section Collabra: Psychology
Starting from 1 July 2026, Collabra: Psychology is on the look-out for a new senior editor for the clinical section as well as several new associate editors for the social section. If you are interest...
docs.google.com
Hi everyone! Collabra: Psychology needs a new senior editor for the clinical section as well as several new associate editors for the social section. If you are interested, please fill out the application form before 30 April 2026. forms.gle/DgM3484SuLVD...
Application Form Senior Editor Clinical/Associate Editor Social Section Collabra: Psychology
Starting from 1 July 2026, Collabra: Psychology is on the look-out for a new senior editor for the clinical section as well as several new associate editors for the social section. If you are interest...
forms.gle
Contribute to open science! Collabra: Psychology needs a new senior editor for the clinical section as well as several new associate editors for the social section. If you are interested, please fill out the application form before 30 April 2026. Repost please! forms.gle/DgM3484SuLVD...
Application Form Senior Editor Clinical/Associate Editor Social Section Collabra: Psychology
Starting from 1 July 2026, Collabra: Psychology is on the look-out for a new senior editor for the clinical section as well as several new associate editors for the social section. If you are interest...
forms.gle
Collabra: Psychology is seeking a new senior editor for the clinical section and new associate editors for the social section. If you are interested in either of these positions and you believe you are qualified, please fill out the application form before 30 April 2026! forms.gle/DgM3484SuLVD...
Application Form Senior Editor Clinical/Associate Editor Social Section Collabra: Psychology
Starting from 1 July 2026, Collabra: Psychology is on the look-out for a new senior editor for the clinical section as well as several new associate editors for the social section. If you are interest...
forms.gle
Testing something: can anyone identify the character I attempted to recreate for my daughter with basic lego blocks?
Why are some scholarly journals moving to transparent peer review? How does it work? And what are the benefits? Learn more in our latest #ScholasticaCommunityConvo interview with @donvanraven.bsky.social EIC of @collabrapsychology.bsky.social. buff.ly/WE173NX
📚 Core principles of responsible generative AI usage in research link.springer.com/article/10.1...
Core principles of responsible generative AI usage in research - AI and Ethics
In a rapidly evolving Generative Artificial Intelligence (GenAI) landscape, researchers, policymakers, and publishers have to continuously redefine responsible research practices. To ensure guidance o...
link.springer.com
I am happy to announce the publication of our new work on the impact of arbitrary analytical choices on type I and type II error rates. We simulated reaction time data in a conflict task and analyzed the notable CSE effect in a multiverse manner. Worrying results: link.springer.com/article/10.3...
Multiverse simulation to explore the impact of analytical choices on type I and type II errors in a reaction time study - Behavior Research Methods
Researcher degrees of freedom in data analysis present significant challenges in social sciences, where different analytical decisions can lead to varying conclusions. In this work, we propose an exam...
link.springer.com
my joint first author @lukaswallrich.bsky.social, @helenahartmann.com, Luisa Altegoer, Veronica Boyce, Sarahanne Field, @janikgoltermann.bsky.social, Joachim Hüffmeier, @drcpennington.bsky.social, @mmpittelkow.bsky.social, @priyasilverstein.com, @donvanraven.bsky.social & @flavioazevedo.bsky.social
Out now: our paper on how to deidentify data sets in the social sciences while navigating privacy concerns. The paper includes a step-by-step de-identification guide and two worked examples, with tons of accompanying material on OSF. journals.sagepub.com/doi/10.1177/...
Sage Journals: Discover world-class research
Subscription and open access journals from Sage, the world's leading independent academic publisher.
journals.sagepub.com
You can sign up until April 22 for the next Causal Inference and Variable Control workshop on May 9 by Peder Isager for the Paul Meehl Graduate School. Workshops are free, and fun, so sign up if interested! paulmeehlschool.github.io/workshops/ca...
Causal Inference and Variable Control | Paul meehl Graduate School
May 9, 2025
paulmeehlschool.github.io
We are starting off with our workshop on Qualitative Open Science by Sarahanne Field for the Paul Meehl Graduate School for Metascience. Looking forward to learning about the state of the art in qualitative research by one of the leading experts on this topic!
Former PhD student Max Linde wrote a paper showcasing a new Bayesian implementation of Cox proportional hazards regression. Out now in Journal of Applied Statistics! doi.org/10.1080/0266...
Bayes factors for two-group comparisons in Cox regression with an application for reverse-engineering raw data from summary statistics
The use of Cox proportional hazards regression to analyze time-to-event data is ubiquitous in biomedical research. Typically, the frequentist framework is used to draw conclusions about whether haz...
doi.org
Excited to share that my first PhD paper got published! We explored the effects of correctly vs. failing to model true interactions in data. Can model misspecification lead to reversed conclusions? Which model generalizes better to a larger sample? Read the article here: doi.org/10.3758/s134...
To interact or not to interact: The pros and cons of including interactions in linear regression models - Behavior Research Methods
Interaction effects are very common in the psychological literature. However, interaction effects are typically very small and often fail to replicate. In this study, we conducted a simulation compari...
doi.org
After my first year as EiC of Collabra: Psychology, I wrote an editorial with my reflections so far. Featured are some observations about submission triage, author geolocation data, and a registered revisions experiment. @collabrapsychology.bsky.social @improvingpsych.org doi.org/10.1525/coll...
General Triage, Geolocation Data, and Registered Revisions: A Peek Under the Hood of Collabra: Psychology
This editorial comes one year after I took the reins of Collabra: Psychology from Simine Vazire. Simine led the journal from 2020 to 2023, and I have had the privilege of working with her during that ...
doi.org