Meta-science/methods improvement people: What are your favorite conferences?

Germany has cancelled funding for the German Cochrane Foundation. Bad news all around. Cochrane’s benefit to cost ratio is huge. @cochrane.org www.sueddeutsche.de/politik/wark...

Bund streicht renommierter Cochrane-Stiftung die Förderung

Die Cochrane-Stiftung, die seit Jahren die Nutzen medizinischer Therapien untersucht, soll künftig nicht mehr staatlich gefördert werden.

sueddeutsche.de

"Systematic reviews are only as credible as the studies they include" INSPECT-SR was published yesterday, giving concrete guidance on how to exclude untrustworthy studies. Cochrane's statement: www.cochrane.org/about-us/new... Article: www.cochrane.org/about-us/new... Guidance: inspect-sr.com

Wake up babe, new Gettier problem just dropped en.wikipedia.org/wiki/Gettier...

Alan Kelly@akellyucc.bsky.social · 3w ago

I always loved this one

My latest @newscientist.com cartoon. many more here: www.newscientist.com/author/tom-gauld/

I’m hiring a PhD student to work with me on metascience in psychology at @zpid.bsky.social! The position is very open - could cover a wide range of topics/themes 🤸🏻‍♀️✨ If you have questions, please reach out! Applications are open until October 1st. leibniz-psychology.onlyfy.jobs/en/job/fyjwt...

PhD in Psychological Meta-Science (m/f/d)

Become part of the open science movement The Leibniz Institute for Psychology Information (ZPID) in Trier (Germany) is an internationally recognized research-based psychology service center located in...

leibniz-psychology.onlyfy.jobs

Article now retracted. Retraction notice focuses on data sharing, but doesn't mention - the ethics review body is the author's own company - the tech used to to collect the data by intercepting users' LLM prompts does not exist ht @grinschglsandra.bsky.social psycnet.apa.org/fulltext/202...

Ian Hussey@ianhussey.mmmdata.io · 4mo ago

Retractionwatch coverage of this article retractionwatch.com/2026/06/16/t... @grinschglsandra.bsky.social @malte.the100.ci @jamiecummins.bsky.social

It's finally here! I gave a TED talk in April in Vancouver, and it was released online today. You can watch it here: ted.com/talks/saloni... I've also adapted it into an article, which was published last week: worksinprogress.co/issue/future...

Have you built an LLM-based research tool and had to stumble your way through figuring out how to validate it? Me too! So I wrote a guide on how to systematically approach this. Preprint here: osf.io/preprints/ps...

Psychological Science is running a special issue on "Advancing Psychological Science using Large Language Models", co-edited by me and @ruben.the100.ci. Check out the calls for submissions below! www.psychologicalscience.org/publications...

RegCheck ( regcheck.app) has received a Commendation from the Society for Improving Psychological Science! You can check the other awardees below too:

RegCheck

RegCheck is an AI tool to compare preregistrations with papers instantly.

regcheck.app

Society for the Improvement of Psychological Science (SIPS)@improvingpsych.org · 3mo ago

🏆We are very pleased to announce the 2026 Awards Winners and Commendations recipients for the Society for the Improvement of Psychological Science! 👏Join us in celebrating the exceptional projects that have revolutionized the field of psychological science. buff.ly/2lUKGFd

Research on cognitive offloading × AI is booming and getting lots of public attention. Unfortunately, some (or even many) of it raises serious credibility concerns. Like this paper, which others and I recently commented on via @pubpeer.com: pubpeer.com/publications...

The methods section is the most important section of a paper. Without knowing the methods, the results are literally meaningless. So it's not OK to relegate the methods to the end. Because this suggests they are an optional afterthought rather than the essential core of the entire paper.

Dan Quintana@dsquintana.bsky.social · 5mo ago

As long as a paper's methods are described *somewhere* I don't think it matters where they are located in a manuscript

In sum, skip the Atlantic on this one and read Monstrous Regiment, a great standalone Pratchett and a perfect book for right now, because it takes on propaganda, war, gender, and how religious zealots starve nations and ruin everything. Quote me on that, why don’t you.

"If I hated to be the bearer of bad news, I wouldn’t have specialized in research methods."

Julia M. Rohrer@dingdingpeng.the100.ci · 5mo ago

New blog post! Let's say an effect you are interested in varies between countries and you want to explain some of that cross-cultural variation. What could possibly go wrong? www.the100.ci/2026/05/20/f...

Austin et al. (2026) advocated for AI in hypothesis-driven scale validation research. In this preprint, led by @wchiggins.bsky.social, we (@malte.the100.ci @bethclarke.bsky.social) sketch out several weaknesses in this paper, and offer recommendations for avoiding them. osf.io/preprints/ps... 1/🧵

New blog post! Let's say an effect you are interested in varies between countries and you want to explain some of that cross-cultural variation. What could possibly go wrong? www.the100.ci/2026/05/20/f...

Friends don’t let friends run moderated cross-country regressions

Header image: Moderate cross-country slopes (Photo: By Erik W. Kolstad - Flickr, CC BY 2.0,) Here’s a particular genre of article that relies on multiple data collection sites, such as studies anal...

the100.ci

There's an interesting conversation unfolding on PubPeer. Inconsistencies were flagged in a paper by a "global keynote speaker on AI&neuroscience" and then the author casually mentions on LinkedIn that she also has pre-post-fMRI for 300 people 👀> pubpeer.com/publications...

PubPeer - Generative artificial intelligence reliance and executive fu...

There are comments on PubPeer for publication: Generative artificial intelligence reliance and executive function attenuation: Behavioral evidence of cognitive offload in high-use adults (2026)

pubpeer.com

When patients ask, “What disorder do I really ‘have’?” the honest answer is usually more interesting and messier than a single diagnostic label. I wrote for the @nytimes.com on what I wish people understood about diagnoses and the nature of mental health problems. www.nytimes.com/2026/05/11/o...

Opinion | We’re Thinking About Mental Health Diagnoses All Wrong

nytimes.com

Hey psychologists, when you're explaining some psychological phenomenon that's perfectly well captured in psychological terms, maybe you don't need to refer to some shitty neuroimaging study with ten people to make it seem more "sciencey"...

This...the fetishizing of unreplicable neuroscience in order to legitimize our work is self-defeating. We don't need to know that depression is in the brain (as opposed to what???) to know it is problematic. How much money have we wasted proving something like depression is "real"?

Kevin Mitchell@wiringthebrain.bsky.social · 5mo ago

Hey psychologists, when you're explaining some psychological phenomenon that's perfectly well captured in psychological terms, maybe you don't need to refer to some shitty neuroimaging study with ten people to make it seem more "sciencey"...

@taymalsalti.bsky.social has done trojan work trying to reproduce the results of three meta-analyses, finding the usual host of issues of effect sizes that are apparently incorrect or non-reproducible Our article is out now: doi.org/10.1111/ejn....

Ian Hussey (@ianhussey.mmmdata.io) contacted me about the recurring problem of unusually large SMD values appearing in published meta-analyses. Very large SMDs can result from using SEs in place of SDs in their calculation, which is a mistake I have also seen in practice. 1/4

Eagle-eyed @grinschglsandra.bsky.social spotted this mess of a plot, with bars that don't match percentages. We, with @malte.the100.ci, quantify a host of other issues we spotted here. pubpeer.com/publications...

If you are interested in EMDR, you probably heard the story about Francine Shapiro "discovering" the method during a walk in the park. This story is largely wrong.

You ever try the 'Reading the Mind in the Eyes test' and wonder, how is that any of them?!

📣 PsychLing-101 — Deadline May 1 Join us in building a large-scale, trial-level psycholinguistic database for cumulative science and LLM evaluation. So far: 36 submissions and 40M+ observations All contributors become coauthors 🤝 🔗 Visit github.com/Data-X01/Psy...

All the more reason to use systematic software designed to tackle this very problem, like RegCheck (regcheck.app)

RegCheck

RegCheck is an AI tool to compare preregistrations with papers instantly.

regcheck.app

Brendan Nyhan@brendannyhan.bsky.social · 6mo ago

Journal editors - the status quo on preregistration is not working! You need to check submissions vs. preregistrations before sending articles out for review. *56%* of experiments I reviewed in last year have severe problems with non-disclosure, undocumented deviations, & more - see Claude summary ↓

I... I started a side project just recently...

Simon Hammann@simonhammann.bsky.social · 6mo ago

Don't be shy to take on a little two-week side project. These five months will be the most precious three years of your academic journey.

I’m hiring a PhD student! The candidate will work alongside @zefreeman.bsky.social, who is joining our research group as postdoc. jobs.unibe.ch/job-vacancie...

PhD Student in Meta-Science and Clinical Psychology - Universität Bern

Universität Bern is looking for PhD Student in Meta-Science and Clinical Psychology

jobs.unibe.ch