In today's dose of dystopia, here's an ad I get hit with every time I use my preferred citation service

An update on our log-like specifications paper! We’ve updated our recommendations and added new commands in Stata and R for one of our recommended alternatives. 1/ osf.io/preprints/me...

Jack Fitzgerald@jackfitzgerald.bsky.social · 5mo ago

New preprint! We reanalyze 46 papers that use log-like specifications (ln(Z+1), inverse hyperbolic sine etc). We find widespread non-robustness, and we show through theory + simulation how these models drive spurious significance. 1/ doi.org/10.31222/osf...

Happy to have the CBS Replication Games (and my replication research more broadly) featured on the ODISSEI Podcast! Tune in if you're interested in hearing @drtomemery.bsky.social and I nerd out over replication!

ODISSEI@odissei.bsky.social · 2mo ago

How can games change research culture? 🧩 On this month's ODISSEI podcast, @drtomemery.bsky.social talks with Jack Fitzgerald about replication, and why it needs to be more embedded in research. That's why the Replication Games were developed, Jack explains. 🎧 Tune in to learn more: edu.nl/eqhuc

How can games change research culture? 🧩 On this month's ODISSEI podcast, @drtomemery.bsky.social talks with Jack Fitzgerald about replication, and why it needs to be more embedded in research. That's why the Replication Games were developed, Jack explains. 🎧 Tune in to learn more: edu.nl/eqhuc

Our paper on the effect of large language models on replicators' success in conducting reproducibility + robustness checks is now published at PNAS. Before advocating that we let AI completely take over the replication process, please read our paper! doi.org/10.1073/pnas...

Institute for Replication@i4replication.bsky.social · 2mo ago

9/ The paper is "AI-Assisted Teams Outperform AI-Led Teams but Not Human-Only Teams in Assessing Research Reproducibility in Quantitative Social Science." Published in PNAS. DOI: doi.org/10.1073/pnas... Preprint: ideas.repec.org/p/zbw/i4rdps...

Ok what's the funniest part? I'm personally a fan of the unhinged 'best of luck' email signoff, though a close second is starting the email off with 'Hi Doctor, Hey.'

Fresh preprint! Using Dutch administrative data, I show that businesses who respond to business surveys are typically unrepresentative, and that this unrepresentativeness is driven by which businesses are contacted for those surveys. 1/ doi.org/10.31235/osf...

My article "Three-Sided Testing to Establish Practical Significance" with @jackfitzgerald.bsky.social is now published in AMPPS! journals.sagepub.com/doi/10.1177/... Three-sided testing is an improved version of TOST that lets you test for equivalence, superiority and inferiority simultaneously.

Sage Journals: Discover world-class research

Subscription and open access journals from Sage, the world's leading independent academic publisher.

journals.sagepub.com

Happy to see my paper with @isager.bsky.social on three-sided testing published at Advances in Methods and Practices in Psychological Science! If you're interested in practical significance testing, give it a read! doi.org/10.1177/2515...

Three-Sided Testing to Establish Practical Significance: A Tutorial - Peder Mortvedt Isager, Jack Fitzgerald, 2026

Researchers may want to know whether an observed statistical relationship is either meaningfully negative, meaningfully positive, or small enough to be consider...

doi.org

Jack Fitzgerald@jackfitzgerald.bsky.social · 2y ago

New paper for holiday reading! @isager.bsky.social and I provide an introduction to three-sided testing, a framework for testing estimates' practical significance. We offer a tutorial, Shiny app, + commands/code in #Rstats, #Jamovi, + #Stata. 1/9 osf.io/preprints/psyarxiv/8y925 #EconSky #PsychSky

Given my stance on log-like specifications, I was surprised to learn that there's a 'news' article on my paper in Nature Human Behaviour, claiming that it actually advocates for the use of IHS specifications. This is categorically untrue. 1/ t.co/ZGjAmHZhLv

Jack Fitzgerald@jackfitzgerald.bsky.social · 5mo ago

New preprint! We reanalyze 46 papers that use log-like specifications (ln(Z+1), inverse hyperbolic sine etc). We find widespread non-robustness, and we show through theory + simulation how these models drive spurious significance. 1/ doi.org/10.31222/osf...

New preprint! We reanalyze 46 papers that use log-like specifications (ln(Z+1), inverse hyperbolic sine etc). We find widespread non-robustness, and we show through theory + simulation how these models drive spurious significance. 1/ doi.org/10.31222/osf...

We're thrilled to open registration for the Utrecht Replication Games. The event will be at the at the University of Utrecht on June 4th. Psych, public health, pol sci and econ studies will be reproduced! Register here: www.surveymonkey.ca/r/Replicatio...

When your spam targets won't submit so you *demand submission* Wishing y'all luck today

Had a wonderful time organizing the scientific side of the CBS Replication Games! Thank you to the replicators for your hard work!

Angelica Maineri@angelicamaineri.bsky.social · 6mo ago

Almost at the end of a very intense 3-day CBS Replication Games! Co-organised by @odissei.bsky.social and @i4replication.bsky.social, 19 researchers (6 teams) came together to replicate 6 papers using Dutch admin data from top economics journal @fialalenka.bsky.social @jackfitzgerald.bsky.social

My Matters Arising concerning a paper on the legal determinants of terrorism is now out in @nathumbehav.nature.com. The original paper is now retracted. To learn why, read on for a story of irregularities, imputations, and impossible values. 1/x doi.org/10.1038/s41562-025-02347-7

Pleased to announce that my paper on hypothetical bias in experiments is now published in Experimental Economics! If you're interested in (how we figure out) whether real stakes and incentives matter in experiments, give it a read! 🔗: doi.org/10.1017/eec....

Jack Fitzgerald@jackfitzgerald.bsky.social · 2y ago

Do real stakes/incentives matter in experiments? Recent studies say they don’t. My new paper shows that these studies’ results — and those of most hypothetical bias experiments — are uninformative when we care about treatment effects. 1/19 #EconSky #PsychSky #PoliSky 🔗: papers.tinbergen.nl/24070.pdf

Had a great time presenting my job market paper at the Lindau Nobel Meeting in Economic Sciences! 🔗 : osf.io/d7sqr_v1/ #LINOecon #EconSky

Registration closes July 4! Come join us in-person or online in Amsterdam!

Institute for Replication@i4replication.bsky.social · last yr.

Only a few days left to register to the Amsterdam Replication Games on July 19. Virtual participation is possible and coauthorship to a meta paper is granted. Register: www.surveymonkey.ca/r/Replicatio...

Dutch academics, please share - replication games are coming to Vrije Universiteit Amsterdam on July 19! If you live in the Netherlands, or want a good reason to visit, come take a day to network, hone your skills, and potentially coauthor a paper. Registration: www.surveymonkey.ca/r/Replicatio...

Replication Games at Vrije Universiteit Amsterdam

Take this survey powered by surveymonkey.com. Create your own surveys for free.

surveymonkey.ca

Institute for Replication@i4replication.bsky.social · last yr.

Registration is open for 7 upcoming replication games: i4replication.org/games.html Looking for researchers in econ/ecology/polsci/psych/pub health San Francisco (June 19) Amsterdam (July 19) Tilburg (Aug 21) Bordeaux (Aug 24) Brno (Sept 7) Paris (Oct 3) Lyon (Oct 9) Short 🧵

#GDRI_rep Update 7: Retraction! Our comment of "Parent–teacher meetings and student outcomes: Evidence from a developing country" has led to the paper being retracted. Our comment is accepted as is. Short 🧵

This will likely be a good initiative, conditional on it not substituting for the journal publishing full comments. Publication is an important incentive for reproducibility/robustness analyses and substantive empirical critiques almost always take more than one page.

Econometrica@ecmaeditors.bsky.social · last yr.

We are pleased to announce an experiment intended to stimulate academic discussion and exchange, centered on papers published in Econometrica 1/5

#GDRI_rep Update 5: We have a new report. We reproduced the paper entitled "Partisan Effects of Information Campaigns in Competitive Authoritarian Elections: Evidence from Bangladesh" by Ahmed, Hodler and Islam published at the Economic Journal. See below for links to report and authors' responses.

What academic journal should I start? Wrong answers only

#GDRI_rep Update 4: We have a new report. We reproduced the paper entitled "Parent–teacher meetings and student outcomes" by Islam @ European Economic Review. See below for links to report and author's response.

Thank you @carlislerainey.bsky.social for boosting my job market paper! I’’m a fan of your prior work on this topic. If you want to learn more, check out the paper and my BIBAP seminar on it tomorrow, 3/12 7 AM CET/5 PM Sydney time. www.unsw.edu.au/business/beh...

Jack Fitzgerald | The Need for Equivalence Testing in Economics

unsw.edu.au

Carlisle Rainey 👨‍💻📊📚@carlislerainey.bsky.social · last yr.

"The Need for Equivalence Testing in Economics" from Jack Fitzgerald (@jackfitzgerald.bsky.social) Preprint: osf.io/preprints/met... We know that "not significant" does not imply evidence for "no effect," but I still see papers make this leap. Good to see more work making this point forcefully!

#5 Here's another recent critique of close elections RDDs. It's unclear whether there is actually good evidence against potentially fatal precise manipulation around the cutoff in these designs.

I'll be waking up early (7 AM CET) on Tuesday, March 12 to present my job market paper at 5 PM Sydney time! If you're awake too, stop by to hear me talk about equivalence testing, replication-based methods research, and the robustness of null results in economics!

Andreas Ortmann@impartialspectator.bsky.social · last yr.

You might be interested in this online talk next Tuesday 5 pm Sydney time. www.unsw.edu.au/business/beh...

Relatedly, I also develop new equivalence testing methods for testing running variable (RV) manipulation in RDD. In 36 RDD publications, I find >44% of RV density discontinuities at treatment cutoffs can't be significantly bounded beneath 50% upward jumps. 🧵: bsky.app/profile/jack...

John Holbein@johnholbein1.bsky.social · last yr.

Lots of talk on X today about rethinking the results produced by close elections RDDs. So, I thought I'd drop a few recent articles about issues that arise in this space so that folks can have them all in one place. 1/N

#GDRI_rep Update 2: I4R sent a report to the original authors for the PLOS One article "“Food insecurity and mental health of women during COVID-19: Evidence from a developing country". All authors have now emailed PLOS One to withdraw their names. osf.io/7tzek/

Institute for Replication@i4replication.bsky.social · last yr.

We completed a full report on “Food insecurity and mental health of women during COVID-19: Evidence from a developing country” PLOS One and shared it with the authors and journal. Two out of three authors have already requested to withdraw their names.

#GDRI_rep Update 1: I4R are now reproducing all published papers that use data from GDRI, or are closely related in other ways. Here is a first update on our work. 🧵