Simon Schug

@smonsays.bsky.social

postdoc @princeton computational cognitive science ∪ machine learning https://smn.one

I think Fodor & Pylyshyn's 1988 paper is possibly the most mischaracterized paper in the history of cognitive science. It's often cited as arguing that neural networks cannot achieve systematicity, compositionality, and productivity. But that's not what they actually argue...

Last term I tried an experiment: I walked into my Tech and Design Ethics class, admitted that I had *no idea* what to do about ChatGPT - so I would let them figure it out. As in: their first project was to decide and write the ChatGPT policy for the class. Here's what happened:

I am recruiting graduate students for the experimental side of my lab @mcgill.ca for admission in Fall 2026! Get in touch if you're interested in how brain circuits implement distributed computation, including dopamine-based distributed RL and probabilistic representations.

I'm joining Princeton University as an Associate Professor of Computer Science and Psychology this fall! Princeton is ambitiously investing in AI and Natural & Artificial Minds, and I'm excited for my lab to contribute. Recruiting postdocs and Ph.D. students in CS and Psychology — join us!

Nassau Hall. Photo credit to Debbie and John O'Boyle

LLMs have shown impressive performance in some reasoning tasks, but what internal mechanisms do they use to solve these tasks? In a new preprint, we find evidence that abstract reasoning in LLMs depends on an emergent form of symbol processing arxiv.org/abs/2502.20332 (1/N)

Emergent Symbolic Mechanisms Support Abstract Reasoning in Large Language Models

Many recent studies have found evidence for emergent reasoning capabilities in large language models, but debate persists concerning the robustness of these capabilities, and the extent to which they ...

arxiv.org

Pre-print 🧠🧪 Is mechanism modeling dead in the AI era? ML models trained to predict neural activity fail to generalize to unseen opto perturbations. But mechanism modeling can solve that. We say "perturbation testing" is the right way to evaluate mechanisms in data-constrained models 1/8

Bild

I wrote an introduction to RL for neuroscience last year that was just published in NBDT: tinyurl.com/5f58zdy3 This review aims to provide some intuition for and derivations of RL methods commonly used in systems neuroscience, ranging from TD learning through the SR to deep and distributional RL!

An introduction to reinforcement learning for neuroscience | Published in Neurons, Behavior, Data analysis, and Theory

By Kristopher T. Jensen. Reinforcement learning for neuroscientists

tinyurl.com

1/ Okay, one thing that has been revealed to me from the replies to this is that many people don't know (or refuse to recognize) the following fact: The unts in ANN are actually not a terrible approximation of how real neurons work! A tiny 🧵. 🧠📈 #NeuroAI #MLSky

Blake Richards@tyrellturing.bsky.social · 2y ago

Why does anyone have any issue with this? I've seen people suggesting it's problematic, that neuroscientists won't like it, and so on. But, I literally don't see why this is problematic...

For my first post on Bluesky .. I'll start by announcing our 2025 edition of EEML which will be in Sarajevo :) ! I'm really excited about it and hope to see many of you there. Please follow the website (and Bluesky account) for more details which are coming soon ..

EEML@eemlcommunity.bsky.social · 2y ago

Hello Bluesky! 🦋 This will be the official account of the Eastern European Machine Learning (EEML) community. Follow us for news regarding our summer schools, workshops, education/community initiatives, and more!

Have you had private doubts whether we'll ever understand the brain? Whether we'll be able explain psychological phenomena in an exhaustive way that ranges from molecules to membranes to synapses to cells to cell types to circuits to computation to perception and behavior?

What counts as in-context learning (ICL)? Typically, you might think of it as learning a task from a few examples. However, we’ve just written a perspective (arxiv.org/abs/2412.03782) suggesting interpreting a much broader spectrum of behaviors as ICL! Quick summary thread: 1/7

The broader spectrum of in-context learning

The ability of language models to learn a task from a few examples in context has generated substantial interest. Here, we provide a perspective that situates this type of supervised few-shot learning...

arxiv.org

Great thread from @michaelhendricks.bsky.social! Reminds me of something Larry Abbott once said to me at a summer school: Many physicists come into neuroscience assuming that the failure to find laws of the brain was just because biologists aren't clever enough. In fact, there are no laws. 🧠📈 🧪

Michael Hendricks 🇨🇦@michaelhendricks.bsky.social · 2y ago

I came across a quote in an article, which I will paraphrase: the ultimate goal of neuroscience is to model the brain and derive laws that define the brain’s computational abilities. Statements like this are common and presented as self-evident, but I think they are wrong.