Ben Prystawski

@benpry.bsky.social

Cognitive science PhD student at Stanford, studying iterated learning and reasoning.

New preprint! AI agents have shown impressive scientific automation capabilities. Can we apply them to psychology research, *including* human data collection? We introduce auto-psych, a framework that proposes cognitive models and uses them to design and run human experiments. 1/

Bild

1st published paper alert ⚠️ in which @mcxfrank.bsky.social and I ask: How robust is the “shape bias”? a phenomenon that has been central to theories of early word learning: If a child hears a new word for an object, they often extend it to other objects with the same shape. tinyurl.com/JCL-shapebias

Examining the Robustness and Generalizability of the Shape Bias: A Meta-Analysis | Journal of Child Language | Cambridge Core

Examining the Robustness and Generalizability of the Shape Bias: A Meta-Analysis

cambridge.org

How do human minds make sense of big, messy problems? 😵‍💫🌀 How do we distill complexity into something simple enough to solve? 🤔💡 We’ll be tackling these questions (and more!) at two workshops on task representations, abstractions, and construals #CogSci2026 #CCN2026 🧵 framing-the-problem.github.io

Framing the Problem — Workshop Series

A workshop series on representation construction in cognitive science and AI. CogSci 2026 (Rio) and CCN 2026 (NYU).

framing-the-problem.github.io

1/ New preprint! Reasoning models often require hundreds of task examples and thousands of rollouts to improve on a task. How can they learn more from much less? Introducing CORE: contrastive self-reflection for rapid, sample-efficient, and interpretable self-improvement 🧵

In neuroscience, we often try to understand systems by analyzing their representations — using tools like regression or RSA. But are these analyses biased towards discovering a subset of what a system represents? If you're interested in this question, check out our new commentary! Thread:

What do representations tell us about a system? Image of a mouse with a scope showing a vector of activity patterns, and a neural network with a vector of unit activity patterns
Common analyses of neural representations: Encoding models (relating activity to task features) drawing of an arrow from a trace saying [on_____on____] to a neuron and spike train. Comparing models via neural predictivity: comparing two neural networks by their R^2 to mouse brain activity. RSA: assessing brain-brain or model-brain correspondence using representational dissimilarity matrices

How do people trade off between speed and accuracy in reasoning tasks without easy heuristics? Come to my talk, "Thinking fast, slow, and everywhere in between in humans and language models," in the Reasoning session this afternoon #CogSci2025 to find out! paper: escholarship.org/uc/item/5td9...

Thinking fast, slow, and everywhere in between in humans and language models

Author(s): Prystawski, Ben; Goodman, Noah | Abstract: How do humans adapt how they reason to varying circumstances? Prior research has argued that reasoning comes in two types: a fast, intuitive type ...

escholarship.org

🚨New paper! We know models learn distinct in-context learning strategies, but *why*? Why generalize instead of memorize to lower loss? And why is generalization transient? Our work explains this & *predicts Transformer behavior throughout training* without its weights! 🧵 1/

How can we combine the process-level insight that think-aloud studies give us with the large scale that modern online experiments permit? In our new CogSci paper, we show that speech-to-text models and LLMs enable us to scale up the think-aloud method to large experiments!

Daniel Wurgaft@danielwurgaft.bsky.social · last yr.

Excited to share a new CogSci paper co-led with @benpry.bsky.social! Once a cornerstone for studying human reasoning, the think-aloud method declined in popularity as manual coding limited its scale. We introduce a method to automate analysis of verbal reports and scale think-aloud studies. (1/8)🧵

Delighted to announce our CogSci '25 workshop at the interface between cognitive science and design 🧠🖌️! We're calling it: 🏺Minds in the Making🏺 🔗 minds-making.github.io June – July 2024, free & open to the public (all career stages, all disciplines)

Despite the world being on fire, I can't help but be thrilled to announce that I'll be starting as an Assistant Professor in the Cognitive Science Program at Dartmouth in Fall '26. I'll be recruiting grad students this upcoming cycle—get in touch if you're interested!

1/13 New Paper!! We try to understand why some LMs self-improve their reasoning while others hit a wall. The key? Cognitive behaviors! Read our paper on how the right cognitive behaviors can make all the difference in a model's ability to improve with RL! 🧵

Bild

What counts as in-context learning (ICL)? Typically, you might think of it as learning a task from a few examples. However, we’ve just written a perspective (arxiv.org/abs/2412.03782) suggesting interpreting a much broader spectrum of behaviors as ICL! Quick summary thread: 1/7

The broader spectrum of in-context learning

The ability of language models to learn a task from a few examples in context has generated substantial interest. Here, we provide a perspective that situates this type of supervised few-shot learning...

arxiv.org