Jonathan S Doucette

@jdoucette.bsky.social

Associate Professor, Department of Politics, Aalborg University. My research examines religion, historical regimes, state formation, and democratization. Personal website: https://t.co/M1J5XAy13P

In terms of its role in Europe's development, the Dominican order is perhaps most known for its part in the inquisition. However, it also had a more benevolent impact on regime change and the development of human capital 1/N

Bild

V-Dem v.16 is now released, w. updated scores for 2025. Most countries remain stable from 2024, but some clear improvements (on diff’t democracy indices), incl. S. Korea, Sri Lanka & Mauritius. Largest declines came, by far, in the US. This figure shows 10-yr changes on the Liberal Dem. index.

Bild

I have a new paper. We look at ~all stats articles in political science post-2010 & show that 94% have abstracts that claim to reject a null. Only 2% present only null results. This is hard to explain unless the research process has a filter that only lets rejections through.

It must be very hard to publish null results
Publication practices in the social sciences act as a filter that favors statistically significant results over null findings. While the problem of selection on significance (SoS) is well-known in theory, it has been difficult to measure its scope empirically, and it has been challenging to determine how selection varies across contexts. In this article, we use large language models to extract granular and validated data on about 100,000 articles published in over 150 political science journals from 2010 to 2024. We show that fewer than 2% of articles that rely on statistical methods report null-only findings in their abstracts, while over 90% of papers highlight significant results. To put these findings in perspective, we develop and calibrate a simple model of publication bias. Across a range of plausible assumptions, we find that statistically significant results are estimated to be one to two orders of magnitude more likely to enter the published record than null results. Leveraging metadata extracted from individual articles, we show that the pattern of strong SoS holds across subfields, journals, methods, and time periods. However, a few factors such as pre-registration and randomized experiments correlate with greater acceptance of null results. We conclude by discussing implications for the field and the potential of our new dataset for investigating other questions about political science.

There have been a number of recent articles on statistical power in quantitative political science. This is something that I think deserves more attention and discussion. A short thread of the articles I have read. 🧵