Ryan Briggs

@ryancbriggs.net

Raising kids & bread & grant money. Cleaning data & diapers & fish. EA (bed nets, not light cone). Social scientist. typos. twitter.com/ryancbriggs

I’m late to this but the ninja creami is viral for good reason. It’s wild how good of a product you can get out of it, including vegan ice cream (almond milk + coconut cream).

We are seeing similar at RP. It's not just AI. Also a huge increase in Chinese social science. Which is often very good. But AI slop is flooding the system. One author with 30 submissions in a month... now they "could" be super productive.... or it could be AI slop.

Ryan Briggs@ryancbriggs.net · 4w ago

Spoke to an editor of a good social science journal who reported submission volume is now 400% higher than during Covid. He entirely blames AI.

Spoke to an editor of a good social science journal who reported submission volume is now 400% higher than during Covid. He entirely blames AI.

I won’t get into the data or analysis here (yet), but I’m very confident that lower ranked journals do not publish more null results than higher ranked ones. I looked across 11 disciplines and all have this (lack of a) pattern.

This was a fun paper. We analyze results from a global survey of development studies (DS) profs and find that the income group of their country doesn't explain much about their views on DS. Instead, their discipline is huge.

Development Studies Association @devcomms.bsky.social · 2mo ago

In a new @eadi.bsky.social reflection paper, @ryancbriggs.net & @andypsumner.bsky.social, @kings-sga.bsky.social explore what drives deep disagreements in development studies—and point to the “disciplinary baggage” of PhD training. Read more: buff.ly/ASH1bL9

New blog post: Evaluating Dr. Cuddy’s Claim that the Debunking of Power Posing is a Myth. daniellakens.blogspot.com/2026/05/eval... On an AI generated description of a non-existent study, incorrectly citing findings from studies, and the importance of scientific criticism.

Evaluating Dr. Cuddy’s Claim that the Debunking of Power Posing is a Myth

In this blog post I will analyse the arguments that Dr. Amy Cuddy provided in a blog post “The "Power Posing Was Debunked" Myth: What the Re...

daniellakens.blogspot.com

In the Fall I'll be teaching a new MA-level methods course entitled "Applied Statistical Evaluation of Development Projects". It will be 12 weeks, in R, and aimed around RCT evaluations. This is a draft outline. What am I missing? What seems redundant?

1. Course Introduction and Setup
 Course overview; installing RStudio; introduction to causal inference; ModernDive Chapters 1–2 for newcomers.
2. Data, Tidy Data, Wrangling, and Visualization
 Core R skills for importing, cleaning, reshaping, summarizing, and visualizing evaluation data.
3. Sampling, Uncertainty, and Inference 
Sampling variation, confidence intervals, hypothesis testing, and the logic of statistical uncertainty.
4. Difference in Means as Regression 
Equivalence between difference-in-means estimates and lm(y ~ treat); ATE as the treatment coefficient; control mean as the intercept; covariates for precision gains; simulations and re-analysis of Karlan–List charity data.
5. Interactions and Treatment Effect Heterogeneity 
Interaction terms, subgroup analysis, heterogeneous effects; simulations, Karlan–List charity data, and Thornton HIV data.
6. Standard Errors, Power, and Research Design 
Bias, variance, RMSE, clustering, power analysis, and how underpowered studies contribute to selection on significance and inflated estimates.
7. Noncompliance, Take-Up, and Instrumental Variables 
ITT, TOT, LATE, compliers etc, and randomized encouragement designs; Thornton HIV testing incentives; reading from The Effect Chapter 19 or Causal Inference: The Mixtape IV chapter.
8. Spillovers, Externalities, and Peer Effects
 How spillovers can bias experimental estimates; identifying, measuring, and interpreting spillover effects in development evaluations.
9. Pre-Analysis Plans, Measurement, and Cost-Effectiveness
 PAPs, outcome measurement, measurement error, index construction, and basic cost-effectiveness analysis.
10. Meta-Analysis and Evidence Aggregation 
Fixed-effect and random-effects meta-analysis; Bayesian meta-analysis using baggr; interpreting accumulated evidence across studies.
11. Case Study: Deworming Evidence I
 Critical re-analysis of the main deworming results; statistical interpretation; cost-effectiveness implications.

An interesting EA forum post that is an anonymized slack chat about GiveWell and EA-style CE analysis: "across EA cost-effectiveness analyses, much more typically goes toward estimating the effect than estimating the costs." forum.effectivealtruism.org/posts/ru3wyS...

Global Health Charity Founders on GiveWell, Evidence Action, and M+E — EA Forum

The following is a lightly edited and anonymized transcript of a discussion among charity founders, researchers, and funders in Ambitious Impact’s Sl…

forum.effectivealtruism.org

I'll be teaching a grad methods class focused on experiments in the fall for a development studies dept. I'm looking for published development RCTs. Ideally they would have: 1. replication packages in R, or 2. fairly simple code I could rewrite in R. Anyone have recommendations?

June 2024: The latest general-purpose LLMs could not count the r's in strawberry. July 2025: The latest general-purpose LLMs get gold in the International Math Olympiad. May 2026: The latest general-purpose LLM solve an 80 year old problem, one of the "best-known questions in combinatorial geometry"

BildBildBild

OpenAI has used a "general purpose reasoning model" to disprove that the square grid type construction is the best solution to the planar unit distance problem. I am sure the "AI is completely useless" crowd will now change their ways, right?

An OpenAI model has disproved a central conjecture in discrete geometry

An OpenAI model solved the 80-year-old unit distance problem, disproving a major conjecture in discrete geometry and marking a milestone in AI-driven mathematics.

openai.com

The City of Ottawa posted the raw speed data from before and after Doug Ford banned speed cameras and the effect is so obvious it's not even necessary put a line marking when that happened. This chart shows the percentage of drivers going 15km/h or more over the posted limit.

Bild

We have a new version of this paper out. The headline results are the same—political science must filter results heavily for statistical significance—but we've added many extensions and rewritten much of it in response to feedback (thank you!). A quick thread on updates 👇

Ryan Briggs@ryancbriggs.net · 6mo ago

I have a new paper. We look at ~all stats articles in political science post-2010 & show that 94% have abstracts that claim to reject a null. Only 2% present only null results. This is hard to explain unless the research process has a filter that only lets rejections through.

It must be very hard to publish null results
Publication practices in the social sciences act as a filter that favors statistically significant results over null findings. While the problem of selection on significance (SoS) is well-known in theory, it has been difficult to measure its scope empirically, and it has been challenging to determine how selection varies across contexts. In this article, we use large language models to extract granular and validated data on about 100,000 articles published in over 150 political science journals from 2010 to 2024. We show that fewer than 2% of articles that rely on statistical methods report null-only findings in their abstracts, while over 90% of papers highlight significant results. To put these findings in perspective, we develop and calibrate a simple model of publication bias. Across a range of plausible assumptions, we find that statistically significant results are estimated to be one to two orders of magnitude more likely to enter the published record than null results. Leveraging metadata extracted from individual articles, we show that the pattern of strong SoS holds across subfields, journals, methods, and time periods. However, a few factors such as pre-registration and randomized experiments correlate with greater acceptance of null results. We conclude by discussing implications for the field and the potential of our new dataset for investigating other questions about political science.

How to post on a twitterlike: 1. spend 20 min listing edge cases and objections to your point, 2. compress each quibble into a single word choice that implicitly addresses it 3. finally, watch replies to the post ignore those qualifiers and perfectly recreate the original list of objections

All welcome at the workshop in 10 days. rohanalexander.com/tdw.html Also, if you read Ryan's piece and thought "hey, I have thoughts on AI and quant social science as well", please do get in touch.

Ryan Briggs@ryancbriggs.net · 4mo ago

I'll be at a workshop organized by @rohanalexander.bsky.social next week on how AI will change quantitative social science. This is my short paper, and this is the key argument. ryancbriggs.net/blog/as-ai-l...

Information manipulation is going to get cheaper much faster than interacting with the world will. I expect that this will lead to the bottleneck in research shifting from production to consumption. We should be preparing for this shift now by building infrastructure that allows us to adjudicate claims and filter work in a world where production is cheap. The current journal system is not well positioned to do this, and so we should be experimenting with new institutions that can.

Me just finishing reading a kid version of Wizard of Oz to 3 year old: “There’s no place like home.” “No” “Is home your favourite place?” “No” “What is your favourite place?” “Hot pot”