Institute for Replication

@i4replication.bsky.social

The Institute for Replication (I4R) works to improve the credibility of science by promoting and conducting reproductions and replications. i4replication.org

This year I joined the editorial team of @jcre.bsky.social, the Journal of Comments and Replications in Economics (JCRE) as a Co-Editor. I'm especially happy that the first submission I handled from start to finish has now been published—together with a reply from the original authors.

JCRE@jcre.bsky.social · 2w ago

New in JCRE: Does Mask Usage Correlate with Excess Mortality? Findings from 24 European Countries. A Comment on Tausk and Spira (BMC Public Health, 2025) by Victor Rangel.

Congratulations to the project “Replication Games,” which received🏆2026 SIPS Mission Award! Replication Games builds community and skills for researchers in one-day hackathons to assess the reproducibility and robustness of published research. 🔗https://buff.ly/nXfbAO8

Institute for Replication (I4R)

The Institute for Replication improves the credibility of science by systematically reproducing and replicating empirical research.

i4replication.org

@i4replication.bsky.social is doing a great job facilitating *debates* about methodology and scientific practises. One can read the arguments and make up their minds: much of the argumentation is made public (instead of being discussed among the editors or other small circles).

Jörg Ankel-Peters@jrgptrs.bsky.social · last mo.

The debate about Borjas/Breznau's paper on ideological bias in migration research is out now @i4replication.bsky.social. With a comment by Katrin Auspurg & Josef Brüderl: hdl.handle.net/10419/341575 And a reply by the original authors: hdl.handle.net/10419/341576

Happy to have the CBS Replication Games (and my replication research more broadly) featured on the ODISSEI Podcast! Tune in if you're interested in hearing @drtomemery.bsky.social and I nerd out over replication!

ODISSEI@odissei.bsky.social · 2mo ago

How can games change research culture? 🧩 On this month's ODISSEI podcast, @drtomemery.bsky.social talks with Jack Fitzgerald about replication, and why it needs to be more embedded in research. That's why the Replication Games were developed, Jack explains. 🎧 Tune in to learn more: edu.nl/eqhuc

The reply to our comment is now online at AEJ:Applied. The broader takeaway: should we trust an IV if removing coding errors requires a different first stage? www.mollylipscomb.com/_files/ugd/a...

Bild
Jörg Ankel-Peters@jrgptrs.bsky.social · 2mo ago

New @i4replication.bsky.social DP: We replicated the seminal Lipsomb et al. paper on electrification in Brazil - and found consequential coding errors. Turns out the paper is based on a fragile IV. After many years, the replication is forthcoming in AEJ:Applied. www.econstor.eu/bitstream/10...

This is a fantastic and rare (!) example of authors of a published paper and the author of a comment on that paper working together to fix the scientific record. Kudos to all involved. This is not easy, even with good faith all around. @droodman.bsky.social @i4replication.bsky.social #EconSky

Institute for Replication@i4replication.bsky.social · 2mo ago

🚨 CORRIGENDUM ALERT 🚨 A decade after Star Wars: The Empirics Strike Back was published in AEJ: Applied, we've just published an official corrigendum with the AEA. This is a love story. 🧵

The authors of the great Star Wars paper and I just posted a 1-page corrigendum. It does not change conclusions. Very fun working with my fellow Jedi meta-scientists. That I checked the work is a measure of the paper's importance. The Force aligned us.

Institute for Replication@i4replication.bsky.social · 2mo ago

🚨 CORRIGENDUM ALERT 🚨 A decade after Star Wars: The Empirics Strike Back was published in AEJ: Applied, we've just published an official corrigendum with the AEA. This is a love story. 🧵

Ongoing replication games at CERDI, Clermont-Ferrand and games yesterday at the Canadian Economic Association in Vancouver! Thanks to the local organizers (Simone Bertoli and Kevin Schnepel) and everyone one who participates! 2 more games within the next 10 days :)

BildBild

This is a great study and (one of?) the first of its kind! A note of caution from a human contributor though: given the slow academic publishing process, the findings should primarily be interpreted as a snapshot of AI capabilities (and the capabilities of researchers using AI) in 2024. (1/4)

Institute for Replication@i4replication.bsky.social · 2mo ago

1/ Can AI help researchers check whether published social science results actually reproduce? In our new PNAS paper, we tested this directly in the AI Replication Games: 288 researchers, 103 teams, and real replication packages from quantitative social science.

1/ Can AI help researchers check whether published social science results actually reproduce? In our new PNAS paper, we tested this directly in the AI Replication Games: 288 researchers, 103 teams, and real replication packages from quantitative social science.

Bild

What can large-scale studies tell us about reproducibility? In our webinar on April 16, researchers from COS, I4R, and META-REP will discuss findings from three papers—one from the recently published SCORE effort—and insights on reproducibility, transparency, and credibility cos-io.zoom.us/webin...

Virtual Event
April 16 // 1 pm ET
NEW EVIDENCE ON REPRODUCIBILITY ACROSS SOCIAL AND BEHAVIORAL RESEARCH
Moderator: Tim Errington
Speakers: Katrin Auspurg, Abel Brodeur, and Andrew Tyner

We are happy to announce the Best Article Award for 2025. This paper examines the impact of papers meant to help reassess previously published papers. These findings are important for our discipline to understand. Congrats to @jrgptrs.bsky.social, Nathan, and Florian! doi.org/10.1111/ecin...

Is economics self‐correcting? Replications in the American Economic Review

This paper reviews the impact of replications published as comments in the American Economic Review between 2010 and 2020. We examine their citations and influence on the original papers' (OPs) subse...

doi.org