How much do outlier decisions matter in meta-analysis? We recompute 358 behavioral science meta-analyses under five outlier treatments. The mean effect barely moves: the median absolute change in d is at most 0.047. meta-analysis.cz/outliers
Zuzana Irsova Havrankova
@irsova.bsky.social
Professor of Economics, Charles University | Stanford METRICS Affiliate | Meta-Research, Labor, International Economics. irsova.com, easymeta.org
Does multi-agent debate improve AI feedback on research papers? Not in our experiment. Authors of 44 econ meta-analyses ranked three blinded AI reports on their own paper: a single prompt beat two multi-agent tools. Paper: meta-analysis.cz/debate
Does Multi-Agent Debate Improve AI Feedback on Research Papers?
Preregistered evaluation of whether multi-agent AI debate improves the quality of AI-generated feedback on research papers.
meta-analysis.cz