We compute a number that should be higher or lower than a criterion. If the effect size is larger than a critical value, it the t-value is larger, or a p-value is smaller, you can say there is something because the long run probability that you are fooling yourself is small enough.
Jesper N. Wulff
@jnwulff.bsky.social
Professor @AarhusUni doing research on organizational research methods and teaching deep neural networks in our Msc. BI program. https://jespernwulff.github.io/
In the last 2 years I (and our lovely collaborators) have been rather obsessively working on Metacheck - a tool to automatically check best practices in papers. In this RIOTS summerschool talk, I walk you through what the tool can do, and future plans www.youtube.com/watch?v=OWd2...
Metacheck: automatically check papers for best practices - Daniel Lakens
Can automated tools help researchers catch problems before their work is published? In this talk from the King’s Open Research Summer School 2026, Professor Daniël Lakens (Eindhoven University of…
youtube.com
I was not reviewer 2. But I am so annoyed by Americans pretending the whole open science movement is funded by John Arnold. His investments are absolutely dwarfed by what the European Union and European science funders have invested in Open science. Only incredibly biased people would ignore this.
I wrote about science funding, science reform, and anti-science agendas. scatter.wordpress.com/2026/07/31/s...
"Enforcement, rather than an intrinsic motivation, led Swiss animal researchers to preregister." New study by Cristina Priboi et al. #MetaSci
A survey of researchers’ attitudes to preregistration in animal research reveals multiple perceived barriers to adoption
Preregistration is a promising and potentially impactful Open Science practice, but remains uncommon in animal research. This survey of animal researchers’ experiences, attitudes and barriers toward p...
doi.org
Sam Neill on tackling depression and imposter syndrome when you’re between jobs.
New blog post: Evaluating Dr. Cuddy’s Claim that the Debunking of Power Posing is a Myth. daniellakens.blogspot.com/2026/05/eval... On an AI generated description of a non-existent study, incorrectly citing findings from studies, and the importance of scientific criticism.
Evaluating Dr. Cuddy’s Claim that the Debunking of Power Posing is a Myth
In this blog post I will analyse the arguments that Dr. Amy Cuddy provided in a blog post “The "Power Posing Was Debunked" Myth: What the Re...
daniellakens.blogspot.com
One of the arguments put to me re: scientific reform is essentially that it will sort itself (poor science is ignored) but of course things only get sorted if scientists are *constantly* doing the difficult work of evaluating competing claims, so "grey" science doesn't spread.
New blog post: Evaluating Dr. Cuddy’s Claim that the Debunking of Power Posing is a Myth. daniellakens.blogspot.com/2026/05/eval... On an AI generated description of a non-existent study, incorrectly citing findings from studies, and the importance of scientific criticism.
"If I hated to be the bearer of bad news, I wouldn’t have specialized in research methods."
New blog post! Let's say an effect you are interested in varies between countries and you want to explain some of that cross-cultural variation. What could possibly go wrong? www.the100.ci/2026/05/20/f...
In this enormous meta-research project we put claims in social-science papers to the test and the results from the project have now been published in Nature.
Today, the SCORE program releases its primary results! 865 researchers examined research credibility across the social and behavioral sciences, publishing three papers in Nature + five preprints. 📑 Explore the papers: www.nature.com/colle... ℹ️ Read more about SCORE: www.cos.io/score
Last week, I mentioned this in passing in a workshop: In 1938 Enrico Fermi won a Nobel Prize for discovering two new elements of the periodic table. Lise Meitner shortly showed that Fermi was mistaken and instead had produced known lighter elements by fission. She did not win a Nobel prize.
A review of the proceedings from four major computer-science conferences showed that none from 2021, and all from 2025, had fake citations. arxiv.org/abs/2602.058... #AI #LLMs #Hallucinations #Misconduct #ScholComm
The Case of the Mysterious Citations
Mysterious citations are routinely appearing in peer-reviewed publications throughout the scientific community. In this paper, we developed an automated pipeline and examine the proceedings of four ma...
arxiv.org
Listen to this. Not a penny more for this. Abolish and prosecute anyone who had anything to do with it.
"A modern-day concentration camp ... People have been killed by the staff here." Irish citizen Seamus Culleton has been in ICE detention since September, despite having a valid work permit and his own business in the US.
Wow this scoring chaos seems to be an extreme case of what I say about many ad hoc analyses: no derivation of method from a clear scientific theory, no assessment of statistical properties, and decades pass before someone notices. This happens in biology too, so let’s not pick on psychology only
Read my latest post for reflections on reproducibility, research quality and a summary of a great new study which shows how NOT to do it https://open.substack.com/pub/tomstafford/p/gambling-with-research-quality
Associate or full position in energy economics at AU! Link in comment
#assa #aea #eea #econjobmarket #academicjobs #iaee | Center for Research in Energy: Economics and Markets - CoRE
Institut for Økonomi, Aarhus Universitet and Center for Research in Energy: Economics and Markets - CoRE, invite expressions of interest from distinguished scholars for a tenured position as Associate...
linkedin.com
(Also, icyi, here are the 42 papers citing our non-existent paper which includes a "meta-analysis" - often called the evidence "gold standard" - of "LLM effects" in education 🤮 scholar.google.com.vn/scholar?star...)
scholar.google.com.vn
Some closing thoughts for my students this semester on LLMs and learning #rstats datavizf25.classes.andrewheiss.com/news/2025-12...
🎯 statsepi.substack.com/p/the-review...
The review I wanted to write…
What happens when people who know better still try to publish their garbage?
statsepi.substack.com
There’s definitely a strategy out there where people start at the highest journal and then just keep trying without any further investment (just keep playing the lottery) & it probably creates enormous amounts of externalities for editors and reviewers www.the100.ci/2020/06/24/m...
“No, we’ve all accepted that the goal is to publish anything and everything and see what sticks. More students. More “collaborations”. So many papers that no human can possibly be paying very much attention to any of it. And we all know where the incentives lie.”
"Runctitiononal features"? "Medical fymblal"? "1 Tol Line storee"? This gets worse the longer you look at it. But it's got to be good, because it was published in Nature Scientific Reports last week: www.nature.com/articles/s41... h/t @asa.tsbalans.se
hahahaha just got an email from someone who was using Claude to generate a boilerplate #QuartoPub document and the LLM *used my name* as the author. The computers are literally trying to be me now 😂🤣🙃🫠
I know that at this point it's a subplot in the Epstein files drama, but I feel compelled to point out, once again, that Larry Summers HAS NO BUSINESS teaching students at ANY university ever again! My latest cries into the abyss, in @thenation.com www.thenation.com/article/soci...
Why Is Larry Summers Still Employed?
The revelations about the economist’s attempts to pressure a women into a “relationship”—with guidance from Jeffrey Epstein—should finally disqualify him from teaching students.
thenation.com
A paper critiquing post-publication peer review has numerous made-up references, including a @nature.com article falsely attributed to our Ivan Oransky. link.springer.com/article/10.1...
PubPeer - An expert criticism on post-publication peer review platform...
There are comments on PubPeer for publication: An expert criticism on post-publication peer review platforms: the case of pubpeer (2025)
pubpeer.com
NEW: Epstein survivors release the most powerful PSA I have ever seen. Make this go viral so every member of the House of Representatives sees it.
TU/e has gained a new research centre: META/e. Daniël Lakens and Krist Vaesen were among the founders of this knowledge hub for metascience—research aimed at improving the practice of science itself. “We want to be a home for every researcher who occasionally wonders: what are we even doing?”
Knowledge centre META/e: home for those improving science
TU/e has gained a new research centre: META/e. Daniël Lakens and Krist Vaesen were among the founders of this knowledge hub for metascience—research aimed at improving the practice of science itself. ...
cursor.tue.nl