It is not easy to characterize the features represented by human language cortex. This work is a step toward doing so. Using small, interpretable feature sets, we explain language-network responses and show a shared feature basis across brain regions, with graded variation across individuals.

Michael Lepori@michael-lepori.bsky.social · 5mo ago

🚨New preprint!🚨 We know that LM representations can be used to predict brain responses to language. But what *features* of these representations underlie this alignment? We use SAEs to find out!

🚨New preprint!🚨 We know that LM representations can be used to predict brain responses to language. But what *features* of these representations underlie this alignment? We use SAEs to find out!

I think Fodor & Pylyshyn's 1988 paper is possibly the most mischaracterized paper in the history of cognitive science. It's often cited as arguing that neural networks cannot achieve systematicity, compositionality, and productivity. But that's not what they actually argue...

🚨New preprint! In-context learning underlies LLMs’ real-world utility, but what are its limits? Can LLMs learn completely novel representations in-context and flexibly deploy them to solve tasks? In other words, can LLMs construct an in-context world model? Let’s see! 👀

I'm excited to share that this paper was accepted at ICLR 2026! We show that language models encode one of the most basic ingredients of a world model: the ability to distinguish plausible from implausible states. Check out the paper for more details! See you in Rio! Paper: arxiv.org/abs/2507.12553

I had a great time helping out on this project with @jennhu.bsky.social and Michael Franke! If you're interested in the intersection of interpretability and cogsci, check it out!

Jennifer Hu@jennhu.bsky.social · last yr.

Excited to share a new preprint w/ @michael-lepori.bsky.social & Michael Franke! A dominant approach in AI/cogsci uses *outputs* from AI models (eg logprobs) to predict human behavior. But how does model *processing* (across layers in a forward pass) relate to human real-time processing? 👇 (1/12)