Valentin Schmutz

@bio-emergent.bsky.social

Trying to find solvable models neuroscientists like. Postdoc @oxfordmathematics.bsky.social https://sites.google.com/view/valentinschmutz

Both brains and RNNs can re-use components of computation across similar tasks or contexts. But what exactly are those “shared components”? How can they be used to solve several tasks? We address these questions in a new preprint with @avm.bsky.social! Link: www.biorxiv.org/content/10.6...

Interpretable compositional computation with recurrent neural networks

Flexible cognition utilizes reusable components to enable rapid adaptation of behavior to different contexts or tasks. Analysis of artificial neural networks trained on multiple tasks suggested that t...

biorxiv.org

Tremendously excited to announce that I will be joining @rockefeller.edu as an Assistant Professor and Head of Lab starting in January 2027! My group will be broadly focused on theoretical neuroscience, and mathematical problems in neural computation in the large.

Rockefeller campus image from https://commons.wikimedia.org/wiki/File:Rockefeller_University_Campus_aerial_2.jpg, licensed under the Creative Commons Attribution-Share Alike 2.5 Generic license.

Really excited to share a new preprint! 𝗛𝗼𝘄 𝗱𝗼 𝗯𝗿𝗮𝗶𝗻𝘀 𝘀𝘁𝗮𝘆 𝗿𝗼𝗯𝘂𝘀𝘁 & 𝗲𝗳𝗳𝗶𝗰𝗶𝗲𝗻𝘁 𝘄𝗵𝗶𝗹𝗲 𝗯𝗲𝗶𝗻𝗴 𝗶𝗻𝗰𝗿𝗲𝗱𝗶𝗯𝗹𝘆 𝘀𝗽𝗮𝗿𝘀𝗲? We explore how! www.biorxiv.org/content/10.6... We built Connectome-based Neural Networks (CoNNs) using Drosophila wiring (larva&adult) & compared with random networks with same sparsity.

Constructing connectome-based neural networks

Ten years ago, I did a research internship with Tilo Schwalger (then in the @gerstnerlab.bsky.social) on deriving mean-field equations from networks of interacting neurons – I have been doing that ever since. I'm still very fond of the way he explains things "à la physicienne".

Gaute Einevoll@gauteeinevoll.bsky.social · 4mo ago

Episode #39 in #TheoreticalNeurosciencePodcast: On modeling neural population activity with mean-field models – with Tilo Schwalger theoreticalneuroscience.no/thn39 How can mean‑field models be systematically derived from the underlying microscopic dynamics of individual neurons?

Cortical circuits are often thought to be specialized, but the same large-scale activity patterns can arise from different circuit architectures. In other words, different instruments can play the same tune, and the same instrument can sometimes play different tunes. www.cell.com/neuron/fullt...

Linking neural manifolds to circuit structure in recurrent networks

Neural population activity can be described either by low-dimensional dynamics on neural manifolds or by single-neuron selectivities. Using a theoretical approach, Pezon et al. relate these two statis...

cell.com

Travelling to COSYNE seems to be the perfect opportunity to announce that I started my own lab at RWTH Aachen University earlier this year, funded by NRW's Ministry of Culture and Science through its Return Program. If you are at COSYNE and want to chat please reach out!

𝗪𝗵𝗮𝘁'𝘀 𝘁𝗵𝗲 𝗿𝗲𝗹𝗮𝘁𝗶𝗼𝗻𝘀𝗵𝗶𝗽 𝗯𝗲𝘁𝘄𝗲𝗲𝗻 𝗺𝗮𝗻𝗶𝗳𝗼𝗹𝗱𝘀 𝗮𝗻𝗱 𝗿𝗲𝗰𝘂𝗿𝗿𝗲𝗻𝘁 𝗻𝗲𝘁𝘄𝗼𝗿𝗸𝘀 𝗶𝗻 𝘁𝗵𝗲 𝗯𝗿𝗮𝗶𝗻? This looks like a must read (suppl material bursting with goodies). #neuroskeyence doi.org/10.1016/j.ne...

Bild

How are neural manifolds and single-neuron response properties related to circuit structure? How degenerate are these relationships? Theory and a plethora of examples can be found in the following paper, out today in Neuron 🌟 It was a privilege to co-supervise first author @lpezon.bsky.social!

Bild
Louis Pezon@lpezon.bsky.social · 5mo ago

Excited to share our new paper to be published in Neuron! With Valentin Schmutz @bio-emergent.bsky.social and Wulfram Gerstner @gerstnerlab.bsky.social, we explore how circuit structure in RNNs shapes network computation and single-neuron responses. www.sciencedirect.com/science/arti...

These workshops are absolutely amazing. I had the privilege to attend the theoretical neuroscience workshop in 2024; it was a memorable week.

Janelia Conferences@janeliaconf.bsky.social · 6mo ago

Apply by May 7 for two early-career #neuro workshops at Janelia! Featuring joint sessions to foster collaboration between theory & experiment. 🧠 🤝 Theoretical Neuroscience→ janelia.news/THE26 Mechanistic Cognitive Neuroscience→ janelia.news/CNW26 @ratecoding.bsky.social @jvoigts.bsky.social

Applications are now open for the summer school: 𝐌𝐚𝐭𝐡𝐞𝐦𝐚𝐭𝐢𝐜𝐚𝐥 𝐌𝐞𝐭𝐡𝐨𝐝𝐬 𝐢𝐧 𝐂𝐨𝐦𝐩𝐮𝐭𝐚𝐭𝐢𝐨𝐧𝐚𝐥 𝐍𝐞𝐮𝐫𝐨𝐬𝐜𝐢𝐞𝐧𝐜𝐞 🧠 Apply before March 15: www.compneuronrsn.org 📍 Located in beautiful Eresfjord 🇳🇴 🗓️ Between July 6-24 Supported by the @kavlifoundation.org In collaboration with @kavlintnu.bsky.social

Mathematical Methods in Computational Neuroscience

Summer school in Eresfjord, Norway (July 8th - 26th, 2024)

compneuronrsn.org

Estimating the power-law exponent of the tail of the eigenspectrum from noisy data is a difficult problem. Here is an approach based on eigenmoment estimation. 👏🏻 A hard stats problem remains open: Can we find an estimator of the tail exponent for which we can PROVE unbiasedness, consistency, etc.?

@deanpospisil.bsky.social · 6mo ago

New paper out at PNAS: www.pnas.org/doi/10.1073/... Revisiting the high-dimensional geometry of population responses in the visual cortex with @jpillowtime.bsky.social. The review took forever because a reviewer was doubtful our new estimator can infer eigenvalues beyond the rank of the data! (1/6)

Very excited about this new work from the omnipotent Owen, with me and Ashok Litwin-Kumar! Can we reconcile low- and high-dimensional activity in neural circuits by recognizing that these circuits ~multitask~? (Plausibly, yes 😊)

Owen Marschall@omarschall.bsky.social · 8mo ago

1/X Excited to present this preprint on multi-tasking, with @david-g-clark.bsky.social and Ashok Litwin-Kumar! Timely too, as “low-D manifold” has been trending again. (If you read thru the end, we escape Flatland and return to the glorious high-D world we deserve.) www.biorxiv.org/content/10.6...

Thank you for having me on BrainInspired, Paul @braininspired.bsky.social! It was such an honor to be on my favorite show—a rare place where we can leisurely talk about manifolds, latent circuits, power laws, and other esoteric ideas, and still be taken seriously in knowing they are all real.

Paul Middlebrooks@braininspired.bsky.social · 8mo ago

Are manifolds real? Are latent circuits real? Tatiana @engeltatiana.bsky.social uses one, infers the other, and says yes to both. Also, how timescales are different and the same across the entire brain... braininspired.co/podcast/226/

Tomorrow at #NeurIPS2025! Oral at 10 am in UL Ballroom 20D and poster #2016 at 11 am. @haydari.bsky.social and I are looking forward to hearing your thoughts.

Valentin Schmutz@bio-emergent.bsky.social · 11mo ago

🎉 "High-dimensional neuronal activity from low-dimensional latent dynamics: a solvable model" will be presented as an oral at #NeurIPS2025 🎉 Feeling very grateful that reviewers and chairs appreciated concise mathematical explanations, in this age of big models. www.biorxiv.org/content/10.1... 1/2

🧵Excited to present our latest work at #Neurips25! Together with @avm.bsky.social, we discover 𝐜𝐡𝐚𝐧𝐧𝐞𝐥𝐬 𝐭𝐨 𝐢𝐧𝐟𝐢𝐧𝐢𝐭𝐲: regions in neural networks loss landscapes where parameters diverge to infinity (in regression settings!) We find that MLPs in these channels can take derivatives and compute GLUs 🤯

Bild