Tom Costello

@tomcostello.bsky.social

research psychologist. beliefs, AI, computational social science. assistant prof at Carnegie Mellon

Today's SJDM Featured Paper is: Costello, T. H., Pelrine, K., Kowal, M., Arechar, A. A., Godbout, J.-F., Gleave, A., Rand, D., & Pennycook, G. (2026). Large language models can effectively convince people to believe conspiracies. arXiv. doi.org/10.48550/arX...

Large language models can effectively convince people to believe conspiracies

Large language models (LLMs) have been shown to be persuasive across a variety of contexts. But it remains unclear whether this persuasive power advantages truth over falsehood, or if LLMs can promote...

doi.org

🧵on my new paper "Synthetic personas distort the structure of human belief systems" w Roberto Cerina I'm v excited about... 🚨 Do synthetic samples look like human samples? We compare 28 LLMs to the 2024 General Social Survey (GSS) to find out + develop host of diagnostics...

🚨New WP: Can an AI voter guide (grounded in information from a nonpartisan, fact-checked source) help voters’ decision making? 🚨 We built and evaluated an LLM-based chatbot that provided voting info in CA & TX (N=2,474) right before the 2024 election. 🧵👇

Bild

If the medium is the message, then the message of algorithmic content platforms is not expression or connection or freedom. It is salience above all else. This is what is happening to us on these platforms. They cannot behave any other way.

The #1 New York Times bestseller The Sirens’ Call is now in paperback! Chris Hayes masterfully explores how our focus has been commodified & manipulated, urging us to reclaim control over our lives & future. The Sirens’ Call is the big-picture vision we urgently need to offer clarity & guidance.

Bild

After years in academia, I’m exploring data science and research roles in industry. I'm a quant. social scientist (PhD Yale ’24, NYU) focused on causal inference, experiments, and large-scale data. Feel free to get in touch or share; all leads appreciated. dwstommes@gmail.com

Our latest collaboration with CMU, Cornell, and others: AI is just as effective at spreading conspiracy beliefs as it is at debunking them. We found a fix that works, showing that we need to make deliberate design choices. Full thread below.

Tom Costello@tomcostello.bsky.social · 7mo ago

If you tell an AI to convince someone of a true vs. false claim, does truth win? In our *new* working paper, we find... ‘LLMs can effectively convince people to believe conspiracies’ But telling the AI not to lie might help. Details in thread

If you tell an AI to convince someone of a true vs. false claim, does truth win? In our *new* working paper, we find... ‘LLMs can effectively convince people to believe conspiracies’ But telling the AI not to lie might help. Details in thread

If you tell an AI to convince someone of a true vs. false claim, does truth win? In our *new* working paper, we find... ‘LLMs can effectively convince people to believe conspiracies’ But telling the AI not to lie might help. Details in thread

I’m less polite: the capabilities q is usually an active denial. in skilled hands, SOTA LLM tools are more capable today than most people think. assume they can do X and you can get through to the real question of what people will do with that and what that reveals about the pressures they’re under

I don’t have a program for reform, but I also don’t think reform is possible unless we change the way we look at the problem. What I’ve tried to do here is make a different question askable—not whether LLMs can “do science” but how they get enrolled within a scientific system whose goals have already been displaced. The capabilities debate has been a way of not seeing the institutional context in which these tools arrive.

IMO, if we want to live in a democracy, we ought to embrace persuasion. When we treat all AI info as bad we are implicitly arguing that voters are incapable of processing arguments. This is an illiberal stance. democracy relies on the "unforced force of the better argument." (Habermas)

Any headline that ends in a question mark can be answered by the word “no” (Betteridge's law). Should we worry about gen AI persuasion shaping elections? I think “no” holds here. See knightcolumbia.org/content/dont... for a good summary of why we shouldn’t be too concerned

Don’t Panic (Yet): Assessing the Evidence and Discourse Around Generative AI and Elections

knightcolumbia.org

Joan from the Bronx@joanfromthebronx.bsky.social · 8mo ago

This is scary stuff.

Very excited this paper is live! Congratulations to first author Hause Lin for being such a badass researcher and all around cool guy

David Rand@dgrand.bsky.social · 8mo ago

In Nature: rdcu.be/eTcbQ In exps with 🇺🇸 🇨🇦 🇵🇱 voters, an AI advocating for one presidential candidate or the other - and shifted attitudes by 4–10+ points 🔹Mechanism= "facts" and information (telling AI to not use facts knocks out persuasion) 🔹Right-leaning bots made more inaccurate "facts"