Just edited our next podcast episode which will be released August 14th. The title of episode 82 is: Scientia: Nova Aetas Aurea. Any ideas what we will discuss?
Daniel Lakens
@lakens.bsky.social
Metascience, statistics, psychology, philosophy of science. Eindhoven University of Technology, The Netherlands. Omnia probate. 🇪🇺
Are you interested in smartphone interventions?📱 We are too. Specifically we were interested in increasing retention in a digital friction intervention. Let me tell you about our new preprint (1/n) with @dgruning.bsky.social @frederik.riedel.wtf @malte.the100.ci using one sec
The Center for Scientific Integrity is proud to announce the inaugural winners of the 2026 Ctrl-Z Award. Named for the universal keyboard shortcut for “undo,” the Ctrl-Z Award this year honors @cetaceanneeded.bsky.social and @katelaskowski.bsky.social for choosing transparency over reputation.
ScienceAdviser Exclusive: Meet the inaugural winners of the Ctrl Z Award
Today in Science and science: Ice age hunters’ penchant for female mammoths, a detailed vagal map, and more
science.org
An explicit pre-analysis plan (as opposed to simply the populated fields of the registration) is, however, more infrequent (about half the incidence of preregistration), nor is it increasing over time.
The overwhelming majority of papers that report preregistration report using the AEA site. (And I would guess many of those that do not report preregistration, actually did preregister their study. Report this information in the paper!)
Stop trying to explain what a p-value is in a single sentence (ICYMI) statsepi.substack.com/p/no-you-can...
No, you can't explain what a p-value is with one sentence (Parts I, II)
But I'm going to try and do it in as few as possible. #fml
statsepi.substack.com
*JOB* My group at @gesis.org has an open position: we are looking for a candidate to support the expansion of our Trusted Research Environment for providing access to sensitive research data: gesis.jobs.personio.de/job/2707934?...
Research Infrastructure Specialist (Postdoc) for Trusted Research Environments (DSS-26) | Jobs at GESIS – Leibniz-Institut für Sozialwissenschaften
GESIS is one of the world's leading social science infrastructure facilities, supporting researchers at all levels of their research projects with expertise and infrastructure services. We help ensure...
gesis.jobs.personio.de
TODAY IS THE DAY! 🥳 "Truth Addict" is officially out! If you/your students want to understand the logic of quantitative research, but w/o the math & jargon, then I'm 95% confident you'll enjoy this book 😉 Anything you can do to help spread the world would be SO appreciated! 🙏
I think there is not better resource out there to educate people about the misconception that there is no effect when p>. 05 then my textbook. The chapter on equivalence testing, lakens.github.io/statistical_... And if needed, chapter 1 on p-values, and perhaps even the section on bayes factors.
9 Equivalence Testing and Interval Hypotheses – Improving Your Statistical Inferences
This open educational resource contains information to improve statistical inferences, design better experiments, and report scientific research more transparently.
lakens.github.io
What explainer/resource do you direct researchers to when they conclude the null hypothesis is true on the basis of not rejecting it? It ought to mention that possible solutions include equivalence testing (or just interpreting the confidence interval) and Bayes factors. Maybe just "ask AI".
Today is the only day you can experience Ray Bradbury’s “There Will Come Soft Rains” on the day it is set. Audio: archive.org/details/brad... PDF: thephilosopher.net/bredberi/wp-...
In the last 2 years I (and our lovely collaborators) have been rather obsessively working on Metacheck - a tool to automatically check best practices in papers. In this RIOTS summerschool talk, I walk you through what the tool can do, and future plans www.youtube.com/watch?v=OWd2...
Metacheck: automatically check papers for best practices - Daniel Lakens
Can automated tools help researchers catch problems before their work is published? In this talk from the King’s Open Research Summer School 2026, Professor Daniël Lakens (Eindhoven University of…
youtube.com
In the last 2 years I (and our lovely collaborators) have been rather obsessively working on Metacheck - a tool to automatically check best practices in papers. In this RIOTS summerschool talk, I walk you through what the tool can do, and future plans www.youtube.com/watch?v=OWd2...
Metacheck: automatically check papers for best practices - Daniel Lakens
Can automated tools help researchers catch problems before their work is published? In this talk from the King’s Open Research Summer School 2026, Professor Daniël Lakens (Eindhoven University of…
youtube.com
Journals should pivot to only publishing experiments as registered reports. This would improve the quality of experiments and decrease publication bias.
Here is your regular reminder that people were saying there was a replication crisis 50 years ago without anyone paying them to do so. Almost as if these people just cared about improving science, and nothing else! rips-irsp.com/articles/10....
Concerns About Replicability Across Two Crises in Social Psychology | International Review of Social Psychology
rips-irsp.com
Psychological Science is running a special issue on "Advancing Psychological Science using Large Language Models", co-edited by me and @ruben.the100.ci. Check out the calls for submissions below! www.psychologicalscience.org/publications...
Special Issue Call for Submissions: “Advancing Psychological Science using Large Language Models”
Editors: Jamie Cummins and Ruben C. ArslanPsychological Science invites submissions for a special issue on psychological science involving large language models. We welcome theoretically and empirical...
psychologicalscience.org
I was not reviewer 2. But I am so annoyed by Americans pretending the whole open science movement is funded by John Arnold. His investments are absolutely dwarfed by what the European Union and European science funders have invested in Open science. Only incredibly biased people would ignore this.
I wrote about science funding, science reform, and anti-science agendas. scatter.wordpress.com/2026/07/31/s...
Analysis Multiversi is out now: nulliusinverba.podbean.com/e/episode-81... What is the epistemic goal of multiverse analysis? Should we incorporate the uncertainty in many analyst approaches into our statistical inferences? (😬)? Is the variability mainly due to low effort of non-experts?
Episode 81: Analysis Multiversi | Nullius in Verba
In this episode, we will discuss multiverse analysis–what it is, why we use it, and how we should use it. We also discuss many analyst projects, and Daniel's new preprint on multiverse analysis.…
nulliusinverba.podbean.com
I still see people who try to defend preregistration for secondary data analysis when the data is publicly accessible. It is a nonsensical thing to do. Fire up a lab notebook and log your decisions, by all means, be transparent. But you can't preregister. www.tandfonline.com/doi/full/10....
The benefits of preregistration and Registered Reports
Practices that introduce systematic bias are common in most scientific disciplines, including toxicology. Selective reporting of results and publication bias are two of the most prevalent sources o...
tandfonline.com
I have a renewed appreciation for the statistical software packages Jamovi and JASP. Use them! In terms of reproducibility, they can't be beat. Archiving the data, code, and output in a single file is a genius move. Achieving the same reproducibility in R is very hard work.
Nice podcast episode with Nature editor Magdalena Skipper on why she believes Metascience is an important young discipline that can help us to understand how to improve our science, and the lessons learned from the Replication Crisis. thehpspodcast.buzzsprout.com/2180146/epis...
S6 E1 - Magdalena Skipper on Scientific Publishing
This week, Thomas Spiteri speaks with Dr. Magdalena Skipper, Editor-in-Chief of Nature. Skipper has held the role since 2018, and has a background in the genetic sciences. She is also notably the…
pocketcasts.com
Het onderliggende probleem is de publish-or-perish-cultuur in de wetenschap: alleen wie schrijft, die blijft: „Een promotieplek of baan krijg je eerder met een lange lijst publicaties dan met een korte lijst.” @lakens.bsky.social Karel Berkhout @nrcwetenschap.bsky.social www.nrc.nl/nieuws/2026/...
Dankzij AI groeit het aanbod van wetenschappelijke artikelen, maar die zijn wel slechter geschreven
Kunstmatige intelligentie: Het gebruik van AI leidt tot verrommeling van de wetenschap. „Er is geen harde kwaliteitstoets in het systeem.”
nrc.nl
Yesterday we recorded a Nullius in Verba podcast episode in which we critically reflect on multiverse analysis, it's misuse, and it's very limited uses in science. I bring up some points of our recent preprint 'There is only one correct analysis' (osf.io/preprints/ps...). Out this Friday!
OSF
osf.io
Always share a data dictionary along with your data so that people aren't guessing what a variable represents. There are many options for creating one (see thread for examples). Choose which one works best for you and share it alongside your data files. :)
New preprint w/ Leo Tiokhin & @lakens.bsky.social! Registered Reports (RRs) are great for science b/c publication is guaranteed before results are known, reducing publication bias & QRPs. This feature supposedly also makes them great for *scientists*. But is that really true? 1/ tinyurl.com/4sy993rr
Career incentives make Registered Reports unattractive under realistic academic conditions
Registered Reports are a publication format designed to reduce publication bias by guaranteeing publication before results are known. This guarantee is considered attractive in the prevailing ‘publish...
tinyurl.com
EXCELLENT: The Netherlands new OA policy seems to be well thought through obc.copim.pub/when-scaling... Policy explicitly recommends redirection & reallocation of funds from existing ‘big deal’ budgets towards community-driven alternatives, incl university-led diamond OA & Netherlands Uni Presses
When 'scaling small' becomes national policy
The Netherlands' new open access strategy echoes the principles the Open Book Collective was built on - 'scaling small' and community-led publishing
obc.copim.pub
The taverne amendment in Dutch copyright law allows all Dutch scientists to share their work - irrespective of the copyrifht publishers like El$evier try to impose - after 6 months. Time for another amendment: After 6 months all publishers are required to make all publications open access.
After a little break due to busy schedules Nullius in Verba will be back with a new podcast episode later today! We will discuss when and how artificial intelligence and automation can improve the way we do science. Keep an eye on your podcast players!
We're hosting a Reproducibility Hackathon on July 24th @edfuturesinstitute.bsky.social to highlight the ongoing reproducibility crisis in the Social Sciences. All welcome. Lunch provided. So, come for the scran, if not the company! Register here: forms.cloud.microsoft/e/NFZwvM4LC
Today we launch the first stable release of RegCheck: v1.0.0. RegCheck makes it easier and quicker to compare study registrations to published papers for consistency - something we know is important in principle, but rarely done in practice. A 🧵 on what's new: regcheck.app
RegCheck
RegCheck is an AI tool to compare preregistrations with papers instantly.
regcheck.app
We are hiring an assistant professor in Metascience! Join our lovely department of Human-Technology Interaction, with a very active Metascience group, at Eindhoven University of Technology. Apply here before August 14, or share the vacancy in your network! www.tue.nl/en/working-a...
Assistant Professor in Metascience
Personal type: Scientific staff
tue.nl