An influential paper by Ariely & Wertenbroch (2002) reported two studies with tampered data. Post 1 of 2. datacolada.org/138

[138] Artificial Deadlines (Part 1): Evidence of Fraud in an Influential Study About Procrastination

A new paper in Psychological Science (.htm) reports a failure to replicate Study 2 of Ariely and Wertenbroch’s influential article entitled, “Procrastination, Deadlines, and Performance: Self-Contr…

datacolada.org

New blog post: Evaluating Dr. Cuddy’s Claim that the Debunking of Power Posing is a Myth. daniellakens.blogspot.com/2026/05/eval... On an AI generated description of a non-existent study, incorrectly citing findings from studies, and the importance of scientific criticism.

Evaluating Dr. Cuddy’s Claim that the Debunking of Power Posing is a Myth

In this blog post I will analyse the arguments that Dr. Amy Cuddy provided in a blog post “The "Power Posing Was Debunked" Myth: What the Re...

daniellakens.blogspot.com

In a Nature study, Team Scientists @szaszibarnabas.bsky.social, Gideon Nave, Michael Inzlicht and collaborators attempted replications of 274 findings from social and behavioral science journals. 55.1% were successfully replicated. https://go.nature.com/3Q4YxuW

Investigating the replicability of the social and behavioural sciences - Nature

A large-scale study on the replicability of claims from social and behavioural science journals reports that about half of the results replicate in the same patterns as the original study.

go.nature.com

Per protocol analysis strikes again! Folks, if you randomize but then don‘t analyze some of the people who got randomized (maybe because they didn’t adhere to instructions, maybe because they dropped out), randomization will no longer do all the heavy causal inference lifting.

Peter Tennant@pwgtennant.bsky.social · 6mo ago

This recent RCT of an "AI stethoscope" claims the technology "shows promise" for diagnosing cardiovascular conditions. It does not. It is a textbook example of the risks of conducting unprincipled 'per protocol analyses'. Once again, peer review at a major medical journal has failed. 🧵 1/

Our lab has the capacity to test ~500 uni students each semester If you’re a researcher in cognitive psychology or metascience and need data collection support, we’d love to collaborate. We can help collect high-quality data from a large student sample. Get in touch to discuss potential projects!

It's ironic to see a discipline care **so much** about unbiasedness (causal inference!) at the level of a single test but then have a research production system and culture that is basically a ferocious bias generation machine. This is not good.

The Iowa Gambling Task is an extreme example of Jingle Fallacy and schmeasurement. In 100 articles we found 244 different ways of scoring it, 177 were never reused. Correlations between them range -.99 to .99. At the same time, we show meta-analyses combine these results as if they’re equivalent.

Annika Külpmann@anniria.bsky.social · 7mo ago

How many versions of the Iowa Gambling Task (IGT) exist? And how much does this affect research using the IGT? More than you might think. 🧵

After 5 years of data collection, our WARN-D machine learning competition to forecast depression onset is now LIVE! We hope many of you will participate—we have incredibly rich data. If you share a single thing of my lab this year, please make it this competition. eiko-fried.com/warn-d-machi...

WARN-D machine learning competition is live » Eiko Fried

If you share one single thing of our team in 2026—on social media or per email with your colleagues—please let it be this machine learning competition. It was half a decade of work to get here, especi...

eiko-fried.com

Do you want to work with me?:) Please spread the word! We are looking for talented Post-doc candidates for a 10-month Junior Fellowship at the Behavioral Science Center, hosted by the Corvinus Institute for Advanced Studies (CIAS). 1/6 www.the-bs-lab.com

Behavioral Science

What do we do? We conduct large-scale behavioral science studies to improve the daily decisions, behavior, and experience of vulnerable individuals (e.g., the well-being of citizens and families / ed...

the-bs-lab.com

This important meta-science article should not be hidden behind a paywall.

Join our Replicability Project: Health Behavior! We have 55 replication studies underway, our target is 65-70. We are only recruiting for secondary data replications--i.e., using existing data to test the original question. Here's a list of studies we think could be feasible. If interested...

Replications Sourcing Sheet

docs.google.com

The Impact of Financial Resources on Cognitive Performance: A Systematic Review and Meta-Analysis, from @peterszecsi.bsky.social, Pal Kolumban, Aikaterini Taka, and @szaszibarnabas.bsky.social doi.org/10.1525/coll...

Today's HotFresh recommended paper is: Szaszi, B., Goldstein, D. G., Soman, D., & Michie, S. (2025). Generalizability of choice architecture interventions. Nature Reviews Psychology, 4(8), 518–529. doi.org/10.1038/s441...

Generalizability of choice architecture interventions - Nature Reviews Psychology

Choice architecture interventions (or ‘nudges’) aim to guide behaviour by changing the proximal physical, social or psychological environment. In this Review, Szaszi and colleagues show that the avera...

doi.org

There still seems to be a lot of confusion about significance testing in psych. No, p-values *don’t* become useless at large N. This flawed point also used to be framed as "too much power". But power isn't the problem – it's 1) unbalanced error rates and 2) the (lack of a) SESOI. 1/ >

Thank you for sharing -- I was unaware of this framework for choosing among replication targets. I think I stand with the critics. Of course I'm left still not knowing how to choose among empirical estimands! Separately, this figure is amazing:

ReplicationResearch.org is now open for submissions! Submit replications and reproductions from many different fields, as well as conceptual contributions. With diamond OA, open and citable peer review reports, and reproducibility checks, we push the boundaries of open and fair publishing.

Can large language models stand in for human participants? Many social scientists seem to think so, and are already using "silicon samples" in research. One problem: depending on the analytic decisions made, you can basically get these samples to show any effect you want. THREAD 🧵

The threat of analytic flexibility in using large language models to simulate human data: A call to attention

Social scientists are now using large language models to create "silicon samples" - synthetic datasets intended to stand in for human respondents, aimed at revolutionising human subjects research. How...

arxiv.org

Read: www.researchgate.net/publication/... Thanks, Anna Dreber & economist team that made this a reality, & @PRASAC for taking lead. Main question: Can prediction markets and surveys accurately predict if classic social psychology & JDM findings will replicate in new data collections?

Did you register to help moderate PsyArXiv preprints but haven’t heard from us yet? Check your spam folder and add psyarxiv@improvingpsych.org to your contacts! We are onboarding moderators in batches to avoid overloading the system, but rest assured we will get to everyone. #PsychSciSky

Society for the Improvement of Psychological Science (SIPS)@improvingpsych.org · last yr.

PsyArXiv is seeking new moderators to help combat an increase in AI submissions! If you've ever posted a preprint to PsyArXiv, please consider joining. Minimum commitment 1h/month, there's a training session this Monday @ 1pm ET. More info here: forms.gle/9LB1rEtxHAeZ... #PsychSciSky

New 📰 Demand characteristics are a fundamental methodological concern in research with humans Yet little is known about the magnitude and consistency of these effects In a new paper, I, M. Wyatt, and @mcxfrank.bsky.social take stock of what we’ve learned via meta-analysis doi.org/10.1525/coll...

If you consume or produce research, I say that you must learn about the commercial publishing system. Start with @forrt.bsky.social's glossary (forrt.org/glossary/eng...), watch the Paywall Movie (www.youtube.com/watch?v=zAzT...) and learn about OA types. Think about who you want to do research for.

In @natrevpsychol.nature.com, Team Scientists @szaszibarnabas.bsky.social, @dggoldst.bsky.social & @dilipsoman.bsky.social and Susan Michie argue that improving how we study nudges—through better design, collaboration, and open science—can help us learn when and where they’re most effective.

Here's a quick blogpost about alternative publishing models. You can bring a horse to water, and indeed wave the bucket temptingly under its nose, but it is likely to gallop off elsewhere. deevybee.blogspot.com/2025/07/new-... @ec.europa.eu @wellcometrust.bsky.social

New publishing models will only work if authors embrace them

Complaints about the broken academic publishing system have been around for years and are getting louder. A common theme is that with the r...

deevybee.blogspot.com

🧵 Can you predict whether behavioral interventions will work in new contexts? … probably not, right? In our new paper with @dggoldst.bsky.social @dilipsoman.bsky.social @susanmichie.bsky.social, we dive into how to better understand and improve generalizability. rdcu.be/ewD2z Summary👇

Generalizability of choice architecture interventions

Nature Reviews Psychology - Choice architecture interventions (or ‘nudges’) aim to guide behaviour by changing the proximal physical, social or psychological environment. In this...

rdcu.be

New paper just dropped: Szaszi, Barnabas, Daniel G. Goldstein, Dilip Soman, Susan Michie. (2025). Generalizability of Choice Architecture Interventions. Nature Reviews Psychology. Thanks to @szaszibarnabas.bsky.social for doing the lion's share! www.nature.com/articles/s44...

Generalizability of choice architecture interventions - Nature Reviews Psychology

Choice architecture interventions (or ‘nudges’) aim to guide behaviour by changing the proximal physical, social or psychological environment. In this Review, Szaszi and colleagues show that the avera...

nature.com

Day 2 of #SIPS2025 ended with a fabulous boat trip! I’ve been told that SIPSers took part in traditional Hungarian dances led by @martonkovacs.bsky.social and @szaszibarnabas.bsky.social . But what happened on the boat, stays on the boat. Tss!

HELP! 🙏 I’m looking for validated emotionally neutral texts (ideally pretested or normed) to use in a control condition. Participants will read the text and count letters. Any leads, references, or resources? 🙏

This is shocking behaviour by Wiley; the stated justification does not stand up. I will not be doing any peer review for Wiley journals in future.

Peer Community in Registered Reports@pci-regreports.bsky.social · last yr.

NEW: Statement from the PCI RR Managing Board on the withdrawal of Infant and Child Development as a PCI RR-friendly journal, and the decision by Wiley to refuse preprints that have been peer-reviewed by @peercommunityin.bsky.social / @pci-regreports.bsky.social Read here ➡️ osf.io/tn8mh

PCI Psychology is here!! 🎉🥳 After over a year of hard work by so many people, we are thrilled to announce that we are open for submissions! Join us in making publishing more efficient, equitable, and open: psych.peercommunityin.org #PsychSciSky #scipub

PsyArXivBot@psyarxivbot.bsky.social · last yr.

Peer Community in Psychology: A platform for peer review of preprints across psychology: https://osf.io/m456e

A recently published meta-analysis in Nature Human Behaviour "found evidence supporting the efficacy of social comparison as a behaviour change technique in shaping behaviour in the desired direction". I was curious, so I re-analyzed the manuscript, but the funnel plots below say it all.