Tim Miller

@tmiller-uq.bsky.social

Professor in Artificial Intelligence, The University of Queensland, Australia Human-Centred AI, Decision support, Human-agent interaction, Explainable AI https://uqtmiller.github.io

Can large language models stand in for human participants? Many social scientists seem to think so, and are already using "silicon samples" in research. One problem: depending on the analytic decisions made, you can basically get these samples to show any effect you want. THREAD 🧵

The threat of analytic flexibility in using large language models to simulate human data: A call to attention

Social scientists are now using large language models to create "silicon samples" - synthetic datasets intended to stand in for human respondents, aimed at revolutionising human subjects research. How...

arxiv.org

ARC says they’ll announced Discovery Indigenous outcomes tomorrow. Recently, announcements have been made around 11am (Canberra time). But even more recently ARC’s comms have been at weird hours, so we’ll see what happens.

Screenshot of tweet from the ARC stating that they’ll announce Discovery Indigenous outcomes tomorrow.

My video about how LLMs are not search engines has led to many, MANY comments telling me that I should be using Perplexity. Some insisting that Perplexity does not hallucinate. Out of a list of 26 papers it just provided me (in "Research" mode) 4 were real. FOUR. 85% hallucination rate.