What explainer/resource do you direct researchers to when they conclude the null hypothesis is true on the basis of not rejecting it? It ought to mention that possible solutions include equivalence testing (or just interpreting the confidence interval) and Bayes factors. Maybe just "ask AI".
Hu Chuan-Peng
@hcp4715.bsky.social
Self cognition | computational modelling | meta-science, open science, diversity| amateur climber. @School of Psychology, Nanjing Normal University
How preprints accelerate the time to first citation of the subsequent journal articles? | Scientometrics | Springer Nature Link https://link.springer.com/article/10.1007/s11192-026-05758-z
How preprints accelerate the time to first citation of the subsequent journal articles? - Scientometrics
This study examines whether journal articles with preprints are cited more rapidly than those without preprints. We construct a matched sample of articles published in the same journal, year, volume, and issue to ensure comparability between articles with and without preprints. Survival analysis is employed to estimate the temporal advantage of articles with preprints in receiving the first citation relative to those without preprints, while OLS regression quantifies this advantage in terms of days. The key findings are as follows: (1) articles with preprints have a 35.2% higher hazard of receiving their first citation than those without preprints; (2) among articles that received at least one citation during the observation period, articles with preprints were associated with a 69.042-day shorter time to first citation than comparable articles without preprints; (3) both early visibility and the additional dissemination channels of preprint platforms are associated with a shorter time to first citation, with early visibility showing a relatively stronger association. Notably, these estimates reflect conditional associations rather than causal effects, given the observational design.
link.springer.com
New Jingle assessment: we show that the "Perspective Taking Protocol" has very poor reliability and near-zero convergent validity with other nominal measures of emotional and spatial perspective taking, empathy, and theory of mind. w/ @malte.the100.ci
The RFT Perspective Taking Protocol has very poor reliability and convergent validity with other measures of perspective taking, empathy, and theory of mind: A jingle assessment: https://osf.io/jb6c4
is there a full text outside the paywall?
New paper on DaBest 2.0, outlining its cool visualizations for complex designs. For both R and python, DaBest is a fantastic, easy tool for focusing on effect sizes and uncertainty. #statsky www.nature.com/articles/s41...
In the last 2 years I (and our lovely collaborators) have been rather obsessively working on Metacheck - a tool to automatically check best practices in papers. In this RIOTS summerschool talk, I walk you through what the tool can do, and future plans www.youtube.com/watch?v=OWd2...
Metacheck: automatically check papers for best practices - Daniel Lakens
Can automated tools help researchers catch problems before their work is published? In this talk from the King’s Open Research Summer School 2026, Professor Daniël Lakens (Eindhoven University of…
youtube.com
Have you built an LLM-based research tool and had to stumble your way through figuring out how to validate it? Me too! So I wrote a guide on how to systematically approach this. Preprint here: osf.io/preprints/ps...
The good news is: STATISTICS is only hard if you want to do it accurately ! 😅😭😂🫠
The good news is: Marketing measurement is only hard if you want to do it accurately ! 😅😭😂🫠
“Contrary to the common assumption that journals reject null results, we found that most projects halt during early data analysis or presentation stages.” New work by @bartekmacka.bsky.social et al. Open Access: doi.org/10.1007/s112...
Congratulations to the project “ESCIMate website and ESCIcheck R package,” which received🏆2026 SIPS commendation! ESCIMate is a tool that checks whether a paper's reported statistics are internally consistent, helping to surface errors and supporting the credibility of the reported evidence.
Mark has kindly invited me to do this interview. How I got into metascience, how my path diverged from the mainstream and more if you're interested. I enjoyed thinking about his questions. Hope you enjoy reading!
Q&A with @devezer.bsky.social about metascience, open science, and her work in this area.
Had the privilege to give a #SAA2026 keynote today. Showed early results from WARN-D ML competition, & EMA'd the audience on how different parts of the data—Baseline, EMA, Wearables, & Followup—contributed to predicting depression onset, with live leaderboard & two prizes. Got 220 live responses:
This practice is happening on a large scale! :( Confuses me that it's called a mill, though,which sounds like something organised, when it seems to just be individual researchers accepting a lot of review requests and asking to be cited.
· #AcademicSky · #AcademicPublishing · #ReviewMills · Review mills — researchers who write fake referee reports with coercive citation requests — are setting off a war in academic publishing. What happens to those caught in the middle?
Great to hear @emilyjacobs.bsky.social talking about her lab's amazing work on precision neuroimaging of women's brains radiolab.org/podcast/this...
This is Your Brain on Hormones - Transcript
We don’t have hormones, hormones have us.
radiolab.org
I'm interested in finding and potentially supporting people who are interested in doing long-form writing on the big efforts in global health: Gavi, Global Fund, PEPFAR, etc. If this is you or someone you know, please make yourself known!
hello everyone, I made this helpful meme to explain how to read scientific papers
Are you ready to shape the future of psychological science? SIPS Executive Committee nominations are still open!🗳️ We are electing 3 seats for 2027–2030: 🔹 Graduate Student or Post-doc 🔹 Faculty (or equivalent) outside the US/Canada 🔹 Faculty or equivalent career stage, including “alt-ac” positions
SIPS Executive Committee Nominations 2026
We are currently soliciting nominations for the Executive Committee of the Society for the Improvement of Psychological Science. Any member may be nominated, and self-nominations are welcome. SIPS…
docs.google.com
A life-course map of health risks associated with exposure to second-hand smoke
A life-course map of health risks associated with exposure to second-hand smoke
Nature Human Behaviour, Published online: 31 July 2026; doi:10.1038/s41562-026-02481-wWe synthesized evidence from 111 meta-analyses to map the comprehensive health risks that are associated with second-hand smoke exposure (SHSE) throughout the life course. Our analyses confirm the strong association of SHSE with lung cancer, cardiovascular disease and a range of adverse fetal and child health outcomes. Moreover, we identify research gaps that should be addressed to inform targeted tobacco control.
dlvr.it
New blog post! Odds ratios are...a bit weird. Here I explain two problems (interpretation, non-collapsibility) and provide some simple recommendations for improved reporting. www.the100.ci/2026/07/30/r...
Reviewer notes: Odds ratios are really odd
When psychological researchers investigate binary outcomes, they routinely report odds ratios to quantify the strength of an effect or an association. This is quite understandable given that psycholog...
the100.ci
A really nice history of how and why the normal distribution (and later, least squares estimation) rose to prominence in the sciences, and how its assumptions present an overly smooth, unimodal, and symmetrical view of human data. journals.sagepub.com/doi/full/10....
Sage Journals: Discover world-class research
Subscription and open access journals from Sage, the world's leading independent academic publisher.
journals.sagepub.com
The within-person associations aren’t necessarily causal because of time-varying confounding, which is something we discuss here: journals.sagepub.com/doi/full/10..... However, we didn’t discuss the scenario of interpreting the between-person associations causally, because that’s…an interesting move
These Are Not the Effects You Are Looking for: Causality and the Within-/Between-Persons Distinction in Longitudinal Data Analysis - Julia M. Rohrer, Kou Murayama, 2023
In psychological science, researchers often pay particular attention to the distinction between within- and between-persons relationships in longitudinal data a...
journals.sagepub.com
Nominate a colleague to become an APS Fellow by October 1! #AcademicSky
APS Fellow Nominations
The 2026 APS Fellows nomination cycle is now open until October 1, 2026. Please consider nominating someone for this honor. Find eligibility requirements and more info here.
psychologicalscience.org
We looked at all 255 articles of animal models of opiod addiction in leading journals 2019 to 2023. Zero preregistered, and zero shared their analysis code. onlinelibrary.wiley.com/doi/full/10....
How Transparent and Reproducible Are Studies That Use Animal Models of Opioid Addiction?
This study assessed transparency, reproducibility and bias minimization practices in animal models of opioid addiction research from 2019 to 2023. Key indices included analysis script sharing, prereg...
onlinelibrary.wiley.com
"Enforcement, rather than an intrinsic motivation, led Swiss animal researchers to preregister." New study by Cristina Priboi et al. #MetaSci
A survey of researchers’ attitudes to preregistration in animal research reveals multiple perceived barriers to adoption
Preregistration is a promising and potentially impactful Open Science practice, but remains uncommon in animal research. This survey of animal researchers’ experiences, attitudes and barriers toward p...
doi.org
Two-year postdoc in meta-research at Carnegie Mellon jobs.chronicle.com/job/38018780...
Postdoctoral Associate in Meta-research - UEIS - Pittsburgh, Pennsylvania, United States job with Carnegie Mellon University | 38018780
Are you a recent Ph.D. graduate in a STEM or social science discipline interested in a career path in meta-research, knowledge synthesis, open...
jobs.chronicle.com
We have a new Economic Inequality topic page— Public attention to economic inequality has grown a lot over the last twenty years. At the same time, the available data has greatly improved too: it now covers many more countries and longer time periods, and is more comparable and accessible than ever
A new study extends research on autobiographical memory processing to two novel domains in adolescents, finding that positive biases in memory processing were associated with good mental health, while these biases were reduced in adolescents at risk of affective disorder: doi.org/10.1111/jcpp.70191
Very happy that my project about "gaming" automated peer review tools has been awarded an NWO XS grant 🤩 🤸♀️ We know that peer review is overburdened, so could we use automated tools to help out? ... maybe, but one of the things we still don't know much about is the risk of "gaming" these tools.
@science.org and @retractionwatch.com partner on a feature today on a clinical trial death that's the saddest, and longest, science story I've edited. But it's also one of the best IMO. Beautifully written and reported by @bborrell.bsky.social We’re grateful to the parents of "Mei" 1/
Exclusive: A cutting-edge gene-editing trial in China went disastrously wrong. A family wants accountability. https://scim.ag/3RuHuDB
Exclusive: Death of girl in Chinese gene-editing trial was never made public
Parents want accountability after study went disastrously wrong, Science and Retraction Watch investigation reveals
scim.ag
This is an absolutely devastating story, told expertly by Reaction Watch's Brendan Borrell. Proud of my @science.org colleagues for their work collaborating with Reaction Watch to bring this story to the world.
Exclusive: A cutting-edge gene-editing trial in China went disastrously wrong. A family wants accountability. https://scim.ag/3RuHuDB