Niklas Jakobsson
@nikljako.bsky.social
Professor at Karlstad Business School, Karlstad University. Interested in dollars, health, and crime.
Incentives to reproduce and replicate articles are so bad. Even when your comment leads to the retraction of a PLOS One article, the reward is a (10 days late) email with a thank you at the bottom. Retraction notice: journals.plos.org/plosone/arti.... But we are not complaining about PLOS One 🧵
1/ Can AI help researchers check whether published social science results actually reproduce? In our new PNAS paper, we tested this directly in the AI Replication Games: 288 researchers, 103 teams, and real replication packages from quantitative social science.
#GDRI_rep Update 10 The orphan article has finally been retracted! Took more than a year, but at last. Read about our investigation (bsky.app/profile/i4re...) and updates ( #GDRI_rep). A good summary: a-ortmann.medium.com/the-asad-isl... and a-ortmann.medium.com/tallying-the...
🧵1/ Our first meta-science paper (with 350+ coauthors) is published today in Nature. It presents one of the largest-ever reproducibility projects in economics & political science. Here’s what we found 👇
Fotbollsallsvenskan börjar om en vecka. Som vanligt blir jag förvånad över att många inte klarar att skilja orsak och verkan, och att statistiken ofta övertolkas. Så här är mitt perspektiv på frågan: Hjälper det att sparka tränaren?
Hjälper det verkligen att sparka tränaren?
Sju sparkade tränare på en enda säsong.
open.substack.com
📢 New Working Paper: “Labor Supply under Temporary Wage Increases: Evidence from a Randomized Field Experiment”, with Mats Ekman and @kotsadam.bsky.social 🔭 arxiv.org/abs/2602.11992
🚨 Our comment on Begum, Grossman & Islam (2018) is now out in Demography @readdemography.bsky.social (w/ @carlbonander.bsky.social, Bensch, @nikljako.bsky.social & Brodeur @i4replication.bsky.social): doi.org/10.1215/0070...
A Commentary on “Gender Bias in Parental Attitude: An Experimental Approach” by Begum, Grossman, and Islam (2018) | Demography | Duke University Press
doi.org
Dagens utdelning från Vetenskapsrådet (VR) till Sveriges nationalekonomer, endast två anslag om totalt 12 miljoner kronor. Så inget trendbrott jämfört med Olles och min granskning. www.tidningencurie.se/debatt/missg...
Missgynnar Vetenskapsrådet ekonomiämnena? | Tidningen Curie
Ekonomiämnena har en lägre beviljandegrad än både statsvetenskap och sociologi och missgynnas när Vetenskapsrådet bedömer ansökningar. Det menar Olle Hammar och Erik Mohlin, efter att ha gått igenom s...
tidningencurie.se
#GDRI_rep Update 9: We have been waiting a couple of months to make two announcements. A few journals were in the process of retracting GDRI article. The editors informed the authors and then lawyers got involved. Who knows how long it will take.
🚨 Our comment on Begum, Grossman & Islam (2018) in @readdemography.bsky.social is now available as an @i4replication.bsky.social working paper (w/ @carlbonander.bsky.social, @nikljako.bsky.social, Bensch & Brodeur). Read it here 👉 www.econstor.eu/bitstream/10...
#GDRI_rep Update 8a: Major updates coming up over the next few weeks. 1st update: We reproduced "Parent–teacher meetings and student outcomes" some time ago. The paper was then retracted by the editors of the Euro Econ Rev. Additional studies are connected (see diagram) 🧵
🚨 REPLICATION REPORT UPDATE: One year ago, a tweet by John Holbein alerted me, @ollefolke.bsky.social, and @jopieboy.bsky.social to a paper with a shocking result about Sweden’s law criminalizing the purchase of sex.🧵
A re-analysis of Ciacci's (2024) "Banning the purchase of sex increases cases of rape: Evidence from Sweden" Journal of Population Economics reveals major issues. A year ago, reproducers Adema, Folke, and Rickne found coding errors driving the paper's key results. Let's unpack this in a 🧵
Where we stand on the Islam-GDRI-Monash saga. A tally and some questions ... a-ortmann.medium.com/tallying-the...
Tallying the fallout of the A. Islam — GDRI — Monash saga (so far) and questions prompted by it …
The I4R has reproduced hundreds of studies over the past three years, and we’ve never seen anything of this scale, said Brodeur. Brendan…
a-ortmann.medium.com
More traction for the Islam - GDRI saga. Monash claiming that he “holds no official position with GDRI and has not received any personal or material benefit from GDRI since its inception in 2010”. Hmmmh. www.theaustralian.com.au/education/mo...
theaustralian.com.au
A Bangladesh-based organization focused on development economics and its founder have been churning out papers filled with misstatements, inconsistencies, ethical lapses and “statistically improbable data,” according to researchers involved in an ongoing effort to replicate the work.
Replication probe finds ‘statistically improbable data’ tied to institute in Bangladesh
Asad Islam A Bangladesh-based organization focused on development economics and its founder have been churning out papers filled with misstatements, inconsistencies, ethical lapses and “statistical…
retractionwatch.com
The Islam - GDRI saga is gaining some traction. retractionwatch.com/2025/04/10/r...
Replication probe finds ‘statistically improbable data’ tied to institute in Bangladesh
Asad Islam A Bangladesh-based organization focused on development economics and its founder have been churning out papers filled with misstatements, inconsistencies, ethical lapses and “statistical…
retractionwatch.com
Fantastic coauthors made this forensic data investigation fire!
Olle Hammar@ollehammar.bsky.social · last yr.Great to see our comment now available online in the European Economic Review! (w/ @carlbonander.bsky.social, @nikljako.bsky.social, @flxhlzmstr.bsky.social, Gunther Bensch & Abel Brodeur @i4replication.bsky.social) 🙌
The original paper is now retracted and our comment accepted for publication in the European Economic Review 🔥
RETRACTED: Parent–teacher meetings and student outcomes: Evidence from a developing country
This article has been retracted: please see Elsevier policy on Article Correction, Retraction and Removal (https://www.elsevier.com/about/policies-and…
sciencedirect.com
Olle Hammar@ollehammar.bsky.social · last yr.In a new @i4replication.bsky.social report we replicate Islam (2019). Main issue: the randomized controlled trial was not randomized. And many other things on top of that. See full report for details. (w/ @carlbonander.bsky.social, @nikljako.bsky.social, @flxhlzmstr.bsky.social, Bensch & Brodeur)
I am very happy that the editors took our report seriously. Hope more retractions will follow.
Institute for Replication@i4replication.bsky.social · last yr.#GDRI_rep Update 7: Retraction! Our comment of "Parent–teacher meetings and student outcomes: Evidence from a developing country" has led to the paper being retracted. Our comment is accepted as is. Short 🧵
#GDRI_rep Update 6: Some of the authors have responded to our report on "Raising Health Awareness in Rural Communities" @ The Review of Economics and Statistics. Authors received our report Feb 6. A short 🧵
Excellent find. How do you do this organizationally? How many enumerators do you need? How do you pay them? How do you get respondents to respond so well that your attrition rate over four waves is only 1.7%? The authors are rather shy on these issues and the costs. Clearly, GDRI worked magically.
Andreas Kotsadam@kotsadam.bsky.social · last yr.This gem is hidden in the response to the response. ”…within a few hours and under extreme time pressure 11,843 households were visited and 22,686 respondents interviewed (two spouses in each household).” Indeed hard to believe 🫠
Some would probably say it is impossible. Or maybe everyone?
Andreas Kotsadam@kotsadam.bsky.social · last yr.This gem is hidden in the response to the response. ”…within a few hours and under extreme time pressure 11,843 households were visited and 22,686 respondents interviewed (two spouses in each household).” Indeed hard to believe 🫠
This gem is hidden in the response to the response. ”…within a few hours and under extreme time pressure 11,843 households were visited and 22,686 respondents interviewed (two spouses in each household).” Indeed hard to believe 🫠
Institute for Replication@i4replication.bsky.social · last yr.#GDRI_rep Update 5: We have a new report. We reproduced the paper entitled "Partisan Effects of Information Campaigns in Competitive Authoritarian Elections: Evidence from Bangladesh" by Ahmed, Hodler and Islam published at the Economic Journal. See below for links to report and authors' responses.
Since we started mass reproducing GDRI, we have requested several replication packages. We have not managed to get a single new replication package as of today (excluding updated packages for one article at the request of editors).
#GDRI_rep Update 5: We have a new report. We reproduced the paper entitled "Partisan Effects of Information Campaigns in Competitive Authoritarian Elections: Evidence from Bangladesh" by Ahmed, Hodler and Islam published at the Economic Journal. See below for links to report and authors' responses.
Bli min kollega! Denna gång söker vi en statistiker (eller liknande) som gärna får jobba både i nationalekonomi och statistik.
Universitetslektor i statistik
Beskrivning Handelshögskolan vid Karlstads universitet (Karlstad Business School) grundades år 2009 och består av arbetsvetenskap, företagsekonomi, informatik, juridik, nationalekonomi och statist
kau.varbi.com
In a new @i4replication.bsky.social report we replicate Islam (2019). Main issue: the randomized controlled trial was not randomized. And many other things on top of that. See full report for details. (w/ @carlbonander.bsky.social, @nikljako.bsky.social, @flxhlzmstr.bsky.social, Bensch & Brodeur)
Institute for Replication@i4replication.bsky.social · last yr.#GDRI_rep Update 4: We have a new report. We reproduced the paper entitled "Parent–teacher meetings and student outcomes" by Islam @ European Economic Review. See below for links to report and author's response.
#GDRI_rep Update 4: We have a new report. We reproduced the paper entitled "Parent–teacher meetings and student outcomes" by Islam @ European Economic Review. See below for links to report and author's response.