Are you interested in smartphone interventions?📱 We are too. Specifically we were interested in increasing retention in a digital friction intervention. Let me tell you about our new preprint (1/n) with @dgruning.bsky.social @frederik.riedel.wtf @malte.the100.ci using one sec
Beth Clarke
@bethclarke.bsky.social
Postdoc at @unibe.ch helping to validate RegCheck (regcheck.app) and doing other metaresearch things 🔍
Have you built an LLM-based research tool and had to stumble your way through figuring out how to validate it? Me too! So I wrote a guide on how to systematically approach this. Preprint here: osf.io/preprints/ps...
Psychological Science is running a special issue on "Advancing Psychological Science using Large Language Models", co-edited by me and @ruben.the100.ci. Check out the calls for submissions below! www.psychologicalscience.org/publications...
Special Issue Call for Submissions: “Advancing Psychological Science using Large Language Models”
Editors: Jamie Cummins and Ruben C. ArslanPsychological Science invites submissions for a special issue on psychological science involving large language models. We welcome theoretically and empirical...
psychologicalscience.org
New blog post! Odds ratios are...a bit weird. Here I explain two problems (interpretation, non-collapsibility) and provide some simple recommendations for improved reporting. www.the100.ci/2026/07/30/r...
Reviewer notes: Odds ratios are really odd
When psychological researchers investigate binary outcomes, they routinely report odds ratios to quantify the strength of an effect or an association. This is quite understandable given that psycholog...
the100.ci
www.aimos2026.org AIMOS 2026 will be in Wellington this year on 30 Nov to 2 Dec. Abstracts due 15 Aug. This is a very fun and very interactive metascience conference. Come along and hang out!
AIMOS_2026 | Metascience Conference – Register Today
Join the AIMOS 2026 Conference n Wellington, New Zealand, for three days of interdisciplinary meta-research, keynote speakers, workshops, and networking to improve research practices.
aimos2026.org
Very happy that my project about "gaming" automated peer review tools has been awarded an NWO XS grant 🤩 🤸♀️ We know that peer review is overburdened, so could we use automated tools to help out? ... maybe, but one of the things we still don't know much about is the risk of "gaming" these tools.
New preprint w/ Leo Tiokhin & @lakens.bsky.social! Registered Reports (RRs) are great for science b/c publication is guaranteed before results are known, reducing publication bias & QRPs. This feature supposedly also makes them great for *scientists*. But is that really true? 1/ tinyurl.com/4sy993rr
Career incentives make Registered Reports unattractive under realistic academic conditions
Registered Reports are a publication format designed to reduce publication bias by guaranteeing publication before results are known. This guarantee is considered attractive in the prevailing ‘publish...
tinyurl.com
RegCheck ( regcheck.app) has received a Commendation from the Society for Improving Psychological Science! You can check the other awardees below too:
RegCheck
RegCheck is an AI tool to compare preregistrations with papers instantly.
regcheck.app
🏆We are very pleased to announce the 2026 Awards Winners and Commendations recipients for the Society for the Improvement of Psychological Science! 👏Join us in celebrating the exceptional projects that have revolutionized the field of psychological science. buff.ly/2lUKGFd
Metascience 2027 is scheduled for June 14-16 in Montreal. We are delighted to partner with the Tanenbaum Open Science Institute for this important meeting. Join the mailing list for updates at: metascience.info
Metascience 2027
A global gathering for knowledge sharing, community building, and opportunities to define a roadmap of research and intervention priorities to improve science.
metascience.info
New paper out now 🥳 When psychologists discuss generalisability, they often refer to vague notions of representativeness. We provide an accessible intro to the total survey error framework as a tool to reason about this more rigorously. w @taymalsalti.bsky.social @ruben.the100.ci >
If you had to guess, what proportion of social/personality psych articles include a claim that the findings can be applied in the real world?
Another metascience assistance prof position! What an exciting time for metascience!
We are hiring an assistant professor in Metascience! Join our lovely department of Human-Technology Interaction, with a very active Metascience group, at Eindhoven University of Technology. Apply here before August 14, or share the vacancy in your network! www.tue.nl/en/working-a...
@jamiecummins.bsky.social has made RegCheck even sleeker! Try it out and let us know what you think!
Today we launch the first stable release of RegCheck: v1.0.0. RegCheck makes it easier and quicker to compare study registrations to published papers for consistency - something we know is important in principle, but rarely done in practice. A 🧵 on what's new: regcheck.app
Our department just announced a new Associate Professor position in quantitative research methodology 🇳🇴 One of the favorable qualifications is experience with open science practices + R/Python experience www.jobbnorge.no/en/available...
Associate Professor in Quantitative Research Methodology (302697) | University of Oslo
Job title: Associate Professor in Quantitative Research Methodology (302697), Employer: University of Oslo, Deadline: Tuesday, September 1, 2026
jobbnorge.no
A unique opportunity to join the RegCheck team! Wonderful colleagues, important research, and an incredible city to live in. I can’t recommend this phd/ postdoc position enough!
WE ARE HIRING! Come work with us (me + @malte.the100.ci) on developing and validating RegCheck. PhD or postdoc applications welcome. Folk with backgrounds in meta-science, psychology, (pre)clinical trials, and/or economics are especially invited to apply. jobs.unibe.ch/job-vacancie...
Really excited for this next chapter at @zpid.bsky.social! 🎉
We are very pleased to officially announce today that @bethclarke.bsky.social will be our tenure-track assistant professor in 💥Psychological Metascience 💥 starting in November 2026! @unitrier.bsky.social #metascience #psychology #leibniz
Interested in doing a postdoc with me in Auckland, New Zealand? 🇳🇿 See info below on a competitive award opportunity, and please spread the word!
The good news is that someone else now gets to join this amazing team! If you're keen to help develop RegCheck, I'd strongly encourage you to apply. Working with @jamiecummins.bsky.social and @malte.the100.ci is reason enough to apply! jobs.unibe.ch/job-vacancie...
PhD Student/ Postdoc Position in Meta-Science - Universität Bern
Universität Bern is looking for PhD Student/ Postdoc Position in Meta-Science
jobs.unibe.ch
Very excited to announce that I’ll be joining @zpid.bsky.social in Trier, Germany as a tenure-track Jun.-Prof. in Psychological Metascience in November! 🤸🏻♀️✨
New website is live, including a new blog post :). I respond to the call by @psychscience.bsky.social asking how we can improve APS conferences. eiko-fried.com/blog/in-pers...
In-person conferences in 2026: yay or nay? | Eiko Fried
Some ideas on improving conferences so they are worth the financial, time, and ecological investments.
eiko-fried.com
🚨JOB ALERT🚨 3 YEAR POSTDOC in #SciComm research at @zpid.bsky.social! @kaisassenberg.bsky.social and me are searching for a postdoc with background in psychology or communication science. Own research ideas are welcome! Focus should be on societies' preparation for future pandemics. Please share!
Application Process
Apply now
leibniz-psychology.onlyfy.jobs
New post! "Making Sense of Replications (and Some Nonsense about the Replication Crisis)," in which I suggest a journal club reading list of new papers on replication, and push back on claims that the replication crisis is fake. getsyeducated.substack.com/p/making-sen...
Making Sense of Replications (and Some Nonsense about the Replication Crisis)
It’s hard to overstate just how much the culture around replication in science has changed over the past 15 years.
getsyeducated.substack.com
Our lab loved this paper when it came out as it combined two of our interests, technology effects and schmeasurement. Plus: Registered report, open data. We read it for our journal club and found issues in the Slovak sample that we now posted to PubPeer: pubpeer.com/publications...
PubPeer - Confusion in gaming disorder measurement
There are comments on PubPeer for publication: Confusion in gaming disorder measurement (2026)
pubpeer.com
First post of the year, new paper out today: we present possibly the biggest case of systematic Measurement Schmeasurement in tech use. It seems that most studies on gaming (videogame) addiction/disorder haven't measured gaming after all. This research took years, so long 🧵 doi.org/10.1098/rsos...
🧵 New PubPeer comment. @cskay.bsky.social & Vlasceanu (2026) propose ECLAIR, an item battery to catch AI-driven bots. We read the preprint in our journal club & found it very interesting, but our read raised several concerns that we posted to PubPeer. pubpeer.com/publications...
PubPeer - A scale for detecting LLM-generated responses in online surv...
There are comments on PubPeer for publication: A scale for detecting LLM-generated responses in online survey research (2026)
pubpeer.com
A scale for detecting LLM-generated responses in online survey research: https://osf.io/4p7ns
The paper "The Bots Ruining Social Science Are Not Bots at All" by Jaffe et al. got a lot of attention when it came out in Perspectives on Psychological Science. We read it in our journal club and have a few comments that we now posted to PubPeer pubpeer.com/publications...
PubPeer - The Bots Ruining Social Science Are Not Bots at All
There are comments on PubPeer for publication: The Bots Ruining Social Science Are Not Bots at All (2026)
pubpeer.com
Can questionable research practices make almost anything look statistically significant? @ephemeralidea.bsky.social explores p-hacking, false positives, and how seemingly small analytical decisions can dramatically influence research findings. Register free; open to all. tinyurl.com/3wbx9tmr
Psychology researchers: Got questions about what kinds of submissions we’re looking for at Psych Science (the journal)? (Short answer: empirical research in any area of psychology!) If you’re at #APS26BCN, stop by the APS booth in the exhibit hall between 4-5pm today to chat with me!
Should automated tools for peer review come with a "nutritional label" for validity?🥪 And if so, what should be on it? Join my workshop on June 5th @ the META/e Conference on Transparency, Technology and AI in Peer Review in Eindhoven! Results will inform our FAIR validation framework. Details >>
New blog post: Evaluating Dr. Cuddy’s Claim that the Debunking of Power Posing is a Myth. daniellakens.blogspot.com/2026/05/eval... On an AI generated description of a non-existent study, incorrectly citing findings from studies, and the importance of scientific criticism.
Evaluating Dr. Cuddy’s Claim that the Debunking of Power Posing is a Myth
In this blog post I will analyse the arguments that Dr. Amy Cuddy provided in a blog post “The "Power Posing Was Debunked" Myth: What the Re...
daniellakens.blogspot.com