Aaron Shaw

@aaronshaw.bsky.social

Usually professoring, parenting, running, etc. Social science and design of digital public goods in online communities. Northwestern University, Chicagoland. https://communitydata.science

LLMs are now widely used in social science as stand-ins for humans—assuming they can produce realistic, human-like text But... can they? We don’t actually know. In our new study, we develop a Computational Turing Test. And our findings are striking: LLMs may be far less human-like than we think.🧵

Computational Turing Test Reveals Systematic Differences Between Human and AI Language

Large language models (LLMs) are increasingly used in the social sciences to simulate human behavior, based on the assumption that they can generate realistic, human-like text. Yet this assumption rem...

arxiv.org

Northwestern faculty Senate has passed a version of the Rutgers mutual defense compact tonight, making it (I think) a dozen faculty governance bodies around the country to do so. Go cats!