Adel Halawa

@ahalawa.bsky.social

Neuroscience PhD student at McGill Co-supervised by Adrien Peyrache & Blake Richards

Great thread! Fun fact related to this (maybe a bit): we find that the smaller PCs in the representations of deep neural networks are actually a better predictor of their task performance than the large ones.

What are the systems in neuroscience that we really have something that we can call “explanation” at all relevant levels, other than reflexive feed-forward like circuits. Here are a few that I would argue are getting there. Obviously not complete explanations but genuinely satisfying.

The Transmitter @thetransmitter.bsky.social · 6mo ago

Neuroscience has become increasingly concerned with prediction, and machine learning with causal explanation, with each field adopting methods from the other, writes @gershbrain.bsky.social. Will this bring us closer to understanding neural systems? www.thetransmitter.org/the-big-pict...

1/X Excited to present this preprint on multi-tasking, with @david-g-clark.bsky.social and Ashok Litwin-Kumar! Timely too, as “low-D manifold” has been trending again. (If you read thru the end, we escape Flatland and return to the glorious high-D world we deserve.) www.biorxiv.org/content/10.6...

A theory of multi-task computation and task selection

Neural activity during the performance of a stereotyped behavioral task is often described as low-dimensional, occupying only a limited region in the space of all firing-rate patterns. This region has...

biorxiv.org

For those interested in open neuroscience learning tools, check out the preprint for “RetINaBox: A hands-on tool for experimental neuroscience" that a couple students in my lab worked on in collaboration with the Trenholm lab: www.biorxiv.org/content/10.1... 🧠📈 🧪

RetINaBox: A hands-on learning tool for experimental neuroscience

An exciting aspect of neuroscience research is developing and testing hypotheses via experimentation. However, due to logistical and financial hurdles, this compelling part of neuroscience research is...

biorxiv.org

NWB just announced that they’re heading for a fiscal cliff next year. 😔 It feels like NWB was really just taking off in terms of data reuse — efforts like these take time and investment. If you want to help push back their cliff, reach out to @bendichter.com

Neurodata Without Borders@nwb.org · last yr.

NWB just turned 10 years old! Researchers worldwide have downloaded 1.9 PB of NWB data from @dandiarchive.org. This animation shows the reach of NWB, facilitating collaboration across the globe. What impact has open neurophysiology data had on your science? Share your stories! 🧠 @openscience

In neuroscience, we often try to understand systems by analyzing their representations — using tools like regression or RSA. But are these analyses biased towards discovering a subset of what a system represents? If you're interested in this question, check out our new commentary! Thread:

What do representations tell us about a system? Image of a mouse with a scope showing a vector of activity patterns, and a neural network with a vector of unit activity patterns
Common analyses of neural representations: Encoding models (relating activity to task features) drawing of an arrow from a trace saying [on_____on____] to a neuron and spike train. Comparing models via neural predictivity: comparing two neural networks by their R^2 to mouse brain activity. RSA: assessing brain-brain or model-brain correspondence using representational dissimilarity matrices

New preprint! 🧠🤖 How do we build neural decoders that are: ⚡️ fast enough for real-time use 🎯 accurate across diverse tasks 🌍 generalizable to new sessions, subjects, and even species? We present POSSM, a hybrid SSM architecture that optimizes for all three of these axes! 🧵1/7

Bild

Preprint Alert 🚀 Multi-agent reinforcement learning (MARL) often assumes that agents know when other agents cooperate with them. But for humans, this isn’t always the case. For example, plains indigenous groups used to leave resources for others to use at effigies called Manitokan. 1/8

Manitokan are images set up where one can bring a gift or receive a gift. 1930s Rocky Boy Reservation, Montana, Montana State University photograph. Colourized with AI

Many recent posts on free energy. Here is a summary from my class “Statistical mechanics of learning and computation” on the many relations between free energy, KL divergence, large deviation theory, entropy, Boltzmann distribution, cumulants, Legendre duality, saddle points, fluctuation-response…

Bild