Over the past two years, I4R partnered with Psychological Science (@psychscience.bsky.social) on a large reproducibility project. 67 independent teams reproduced 64 articles published in 2024–2025, about 44% of eligible papers. Paper: www.econstor.eu/bitstream/10... Here's what we learned 🧵

🚀Making Replications Count Hackathon🚀 create open source tools that make replication studies impossible to ignore. 📅11th-13th November 2026 Münster, Germany ✈️ Travel & accommodation covered Looking for coders, data wranglers, UX folks & open science enthusiasts Apply: indico.uni-muenster.de/e/marco3

Here’s my conversation with Chris Chambers on Metascience Matters. Chris was the first journal editor to offer registered reports, starting in 2013 at Cortex. youtu.be/PgZjgZlxsYw?...

Registered reports | Chris Chambers

YouTube video by Metascience Matters

youtu.be

I sincerely hope this paper will be seen as a turning point in how the medical sciences think and approach the issue of trustworthiness assessment (and I hope the social sciences follow suit!). Congrats to @jdwilko.bsky.social and colleagues (incl. @ianhussey.mmmdata.io and @lhdjung.bsky.social)!

The Cochrane Collaboration@cochrane.org · 7d ago

INSPECT-SR – a tool for assessing the trustworthiness of randomized controlled trials – has been published today in @bmj.com, giving researchers a structured way to identify problematic studies before they're included in systematic reviews. 🔗 www.cochrane.org/about-us/new... #ResearchIntegrity

New paper! Despite qualitative researchers claiming that generalizability is not a goal, their published work does indeed contain generalizable claims. We document this and provide recommendations for how all researchers can better calibrate their generalizability claims. doi.org/10.1177/2515...

Come work on a PhD in Metascience with me! There’s just a little over one week left to apply!

Beth Clarke@bethclarke.bsky.social · last mo.

I’m hiring a PhD student to work with me on metascience in psychology at @zpid.bsky.social! The position is very open - could cover a wide range of topics/themes 🤸🏻‍♀️✨ If you have questions, please reach out! Applications are open until October 1st. leibniz-psychology.onlyfy.jobs/en/job/fyjwt...

Please anonymise your data before sharing ! At the @lmu-osc.bsky.social we promote responsible data sharing through data anonymisation, or the creation of synthetic data to share instead of sensitive data. Our self-paced tutorials: lmu-osc.github.io/data-anonymi... lmu-osc.github.io/synthetic-da...

Institute for Replication@i4replication.bsky.social · 3w ago

1/ What is the prevalence of personally identifiable information (PII) in author-collected data publicly shared in the social sciences? We audited 327 replication packages from 11 leading journals in economics, political science, and psychology Answer: surprisingly high 🧵

New preprint! 🎉 I analysed 1660 papers from 4 psychology journals and found materials sharing went from 9% of papers in 2015 to 82% in 2025, and these materials *do* get downloaded — a median of 135 times each. BUT shared code is often hard to run. doi.org/10.31234/osf... Let's walk through it 🧵

🎉 COS has established an independent subsidiary organization in Brussels! While the Belgian organization is legally independent from COS in the US, it will not operate separately—it's part of one integrated, global COS organization with a shared mission, strategy, & brand

A New Chapter for COS in Europe

The Center for Open Science (COS) has officially established an independent subsidiary organization in Brussels, Belgium. This presence gives COS flexibility to engage with European institutions, organizations, funders, and communities.

cos.io

I most definitely didn’t expect this to get covered by 2P4B, yet here we are. Very nice episode, can recommend!

Michael Inzlicht@minzlicht.bsky.social · last mo.

New episode of @fourbeerspod.bsky.social We had @andymasley.bsky.social on to the show to discuss AI and the environment. We got into data centers, effective altruism and TESCREAL, and whether you should trust a researcher based on who funds them. This was a real fun one! www.fourbeers.com/133

🚨 New preprint: In this paper we make the case for measuring social media use at the level of naturally occurring sessions (i.e., beginning when the app/site is opened and ending when it is closed). Across 7 days and 161 participants this gave us nearly 4,000 paired sessions of use 🧵

For the Replicability Project: Health Behavior we need some editors and reviewers of analysis plans for secondary data replications, especially for complex designs including multilevel, weighting, clustering, missing data. Earns coauthorship on the summary paper. Interested? replications@cos.io

Psych Science has retracted Ariely & Wertenbroch (2002). The second author requested the retraction. Both authors agreed to it. journals.sagepub.com/doi/full/10.... So grateful to @datacolada.bsky.social for these blog posts and the work behind them: datacolada.org/138 and datacolada.org/139 1/2

Sage Journals: Discover world-class research

Subscription and open access journals from Sage, the world's leading independent academic publisher.

journals.sagepub.com

Really enjoyed chatting with Randy! I highly recommend checking out his podcast if you haven’t already @metasciencematters.bsky.social

Randy Ellis@randalljellis.bsky.social · 4w ago

Here's my conversation with @bethclarke.bsky.social, incoming Junior Professor of Psychological Metascience at the Leibniz-Institut für Psychologie. www.youtube.com/watch?v=2Hak... We discussed direct replications, how study limitations are ignored, and p-curving social and personality psychology.

I made a mistake. And because of that mistake, I no longer have confidence that results that I reported in several research papers are an accurate reflection of replication rates. 1/

Send your best work to Psychological Science! Four special issue calls: 1. Descriptive Research in Psychological Science www.psychologicalscience.org/publications... 2. Advancing Psychological Science Using Large Language Models www.psychologicalscience.org/publications...

Psychological Science special issue call 📣 Ever had your research denigrated bc it's "only descriptive", "what's the mechanism though?" and "but what are the theoretical implications?" Now has come your time to shine. Send your best descriptive work! www.psychologicalscience.org/publications...

New Blog post: Which Data Repository Should you Use? In light of OSF closing down, I compare Zenodo, Dataverse, ResearchBox, PsychArchive, and local repositories on six important dimensions. If you want to know which to pick: It depends! daniellakens.blogspot.com/2026/08/whic...

Which Data Repository Should You Use?

The Center for Open Science has announced that from November 16, 2026, no new projects can be created on the Open Science Framework. After F...

daniellakens.blogspot.com

🎉 ReproducibiliTea 2026 Conference | 25 September 2026 “A decade on & decades ahead” ☕ Session 1 | 10:50–11:50 👉 Register for the ReproducibiliTea 2026 Conference and discover the full program, speakers, and session details on our website: 🔗 reproducibilitea.org/conference2026

I’m hiring a PhD student to work with me on metascience in psychology at @zpid.bsky.social! The position is very open - could cover a wide range of topics/themes 🤸🏻‍♀️✨ If you have questions, please reach out! Applications are open until October 1st. leibniz-psychology.onlyfy.jobs/en/job/fyjwt...

PhD in Psychological Meta-Science (m/f/d)

Become part of the open science movement The Leibniz Institute for Psychology Information (ZPID) in Trier (Germany) is an internationally recognized research-based psychology service center located in...

leibniz-psychology.onlyfy.jobs

Congratulations to the project “RegCheck,” which received🏆2026 SIPS commendation! RegCheck is a tool that makes it easier and quicker for researchers to compare published papers with their associated study registrations. regcheck.app

RegCheck

RegCheck is an AI tool to compare preregistrations with papers instantly.

regcheck.app

My favorite Metascience conference will land in Copenhagen next year. The 9th (!) edition of the Perspectives on Science Error conference will be from January 27 to 29. Block your calendar, and see you there! errorsin.science

It’s amazing what Brian and OSF have done for science. I can imagine how hard the folks at COS must’ve worked to avoid this outcome. I’m extremely grateful to them for creating the reality we live in now. The fact that we’ll miss these services so acutely is a testament to how much they shaped us.

Brian Nosek@briannosek.bsky.social · 2mo ago

Over the next several months, we will phase out some popular OSF features. These changes do not affect current public content, which remains safe and accessible. We have prepared support material to help users adapt. I am very sorry for the disruption to your work. Please read this post for details.

Over the next several months, we will phase out some popular OSF features. These changes do not affect current public content, which remains safe and accessible. We have prepared support material to help users adapt. I am very sorry for the disruption to your work. Please read this post for details.

OSF Changes | Center for Open Science

We are preparing substantial changes to OSF that will reduce its functionality, focus OSF on its unique strengths, and move toward an integrated model with complementary services. As part of that shif...

cos.io

Are you interested in smartphone interventions?📱 We are too. Specifically we were interested in increasing retention in a digital friction intervention. Let me tell you about our new preprint (1/n) with @dgruning.bsky.social @frederik.riedel.wtf @malte.the100.ci using one sec

Have you built an LLM-based research tool and had to stumble your way through figuring out how to validate it? Me too! So I wrote a guide on how to systematically approach this. Preprint here: osf.io/preprints/ps...

Psychological Science is running a special issue on "Advancing Psychological Science using Large Language Models", co-edited by me and @ruben.the100.ci. Check out the calls for submissions below! www.psychologicalscience.org/publications...

New blog post! Odds ratios are...a bit weird. Here I explain two problems (interpretation, non-collapsibility) and provide some simple recommendations for improved reporting. www.the100.ci/2026/07/30/r...

Reviewer notes: Odds ratios are really odd

When psychological researchers investigate binary outcomes, they routinely report odds ratios to quantify the strength of an effect or an association. This is quite understandable given that psycholog...

the100.ci

www.aimos2026.org AIMOS 2026 will be in Wellington this year on 30 Nov to 2 Dec. Abstracts due 15 Aug. This is a very fun and very interactive metascience conference. Come along and hang out!

AIMOS_2026 | Metascience Conference – Register Today

Join the AIMOS 2026 Conference n Wellington, New Zealand, for three days of interdisciplinary meta-research, keynote speakers, workshops, and networking to improve research practices.

aimos2026.org

Very happy that my project about "gaming" automated peer review tools has been awarded an NWO XS grant 🤩 🤸‍♀️ We know that peer review is overburdened, so could we use automated tools to help out? ... maybe, but one of the things we still don't know much about is the risk of "gaming" these tools.