Tessera
Folgen

Diana Jordan

@dianamejordan.bsky.social

PhD Candidate in Political Science at Duke University. Studying American politics, political behavior, and survey research.

2 Posts40 Follower29 Folgt
Andrew Trexler@atrexler.com · 5mo ago

Thrilled to announce my paper with @dianamejordan.bsky.social & sky-less Trent Ollerenshaw is now published open-access at @apsrjournal.bsky.social. In a (very) large replication & extension, we show that design effects of repeated measure experiments are nonzero but typically small. Thread:

Abstract for "New Evidence and Design Considerations for Repeated Measure Experiments in Survey Research" by Diana Jordan, Trent Ollerenshaw, and Andrew Trexler, published in the American Political Science Review. The abstract text reads: "We re-examine recent influential claims that repeated measure experimental designs offer large precision gains without biasing treatment effect estimates in survey research. We test these claims by experimentally varying the design of six classic political science experiments across three distinct large samples of U.S. adults (total N = 13,163). In contrast to prior evidence, we observe consistent attenuation of treatment effects in repeated measure designs. However, we show in simulations that this average design effect is small enough, and the precision gains large enough, that we recommend repeated measure designs for broad application—though (large-N) post-only designs may be preferable when research priorities include estimating the precise magnitude of a treatment effect. We additionally explore how several design considerations affect the bias-precision trade-off, such as within-subject versus between-groups designs, the relative separation of repeated measures within single surveys, and differences in respondent characteristics across sample types."
Cambridge University Press Political Science & IR@cambup-polsci.cambridge.org · 5mo ago

#OpenAccess from @apsrjournal.bsky.social - New Evidence and Design Considerations for Repeated Measure Experiments in Survey Research - https://cup.org/4sVtFLj - @dianamejordan.bsky.social, TRENT OLLERENSHAW & @atrexler.com #FirstView

A graphic with a green and blue background. The top green section displays the text "#OpenAccess" in white. The bottom blue section shows the text "American Political Science Review" in white.