Tessera
Folgen

Joe Ketterling

@jketterling.bsky.social

Fitness fanatic. Sport & Exercise psychology researcher. CSCS. PhD Student. #RStats Nerd. https://linkedin.com/in/joketter

77 Posts282 Follower493 Folgt
Ryan Briggs@ryancbriggs.net · 7mo ago

I have a new paper. We look at ~all stats articles in political science post-2010 & show that 94% have abstracts that claim to reject a null. Only 2% present only null results. This is hard to explain unless the research process has a filter that only lets rejections through.

It must be very hard to publish null results Publication practices in the social sciences act as a filter that favors statistically significant results over null findings. While the problem of selection on significance (SoS) is well-known in theory, it has been difficult to measure its scope empirically, and it has been challenging to determine how selection varies across contexts. In this article, we use large language models to extract granular and validated data on about 100,000 articles published in over 150 political science journals from 2010 to 2024. We show that fewer than 2% of articles that rely on statistical methods report null-only findings in their abstracts, while over 90% of papers highlight significant results. To put these findings in perspective, we develop and calibrate a simple model of publication bias. Across a range of plausible assumptions, we find that statistically significant results are estimated to be one to two orders of magnitude more likely to enter the published record than null results. Leveraging metadata extracted from individual articles, we show that the pattern of strong SoS holds across subfields, journals, methods, and time periods. However, a few factors such as pre-registration and randomized experiments correlate with greater acceptance of null results. We conclude by discussing implications for the field and the potential of our new dataset for investigating other questions about political science.
Joe Ketterling@jketterling.bsky.social · 11mo ago

IRB peer-review should always be publicly available for every published study (without requesting it). Even if it’s exempt. Transparency matters. But mostly I want to know how the hell you got that study approved. 😂

Joe Ketterling@jketterling.bsky.social · last yr.

“Doing research means discovering something no one else knows and it’s fun. It moves us forward. It reveals what’s surprising or strange in our world, and teaches us how things work.” www.inforum.com/opinion/lett...

Letter: Support science in North Dakota

Ben Balas of Fargo writes: "If you’re not sure about the value of science to you and your community, I urge you to get in touch with a local scientist (including me) and ask questions."

inforum.com

Joe Ketterling@jketterling.bsky.social · last yr.

This article hits home & reflects a lot of my teaching philosophy. I’ve spent little time teaching, but I’ve spent a ton of time being a student. It wasn’t until my instructor education toward the end of my didactic career that I understood how to learn. theeffortfuleducator.com/2025/02/10/o...

Obsessions and John Hattie - The Effortful Educator

Teachers are obsessed with teaching, but are they obsessed with learning?

theeffortfuleducator.com

Courtney (Dr. Version)@cakrolik.bsky.social · last yr.

Totally blew some students' minds last week with the fact that Bluetooth was named after King Harald Bluetooth who united the tribes of Denmark into a single kingdom (bc Bluetooth technology connects devices) AND the Bluetooth symbol is a bind rune that combines his initials, H (ᚼ) and B (ᛒ).