A Erdem Sagtekin

@aesagtekin.bsky.social

theoretical neuroscience phd student at columbia

1/X Excited to present this preprint on multi-tasking, with @david-g-clark.bsky.social and Ashok Litwin-Kumar! Timely too, as “low-D manifold” has been trending again. (If you read thru the end, we escape Flatland and return to the glorious high-D world we deserve.) www.biorxiv.org/content/10.6...

A theory of multi-task computation and task selection

Neural activity during the performance of a stereotyped behavioral task is often described as low-dimensional, occupying only a limited region in the space of all firing-rate patterns. This region has...

biorxiv.org

How to find all fixed points in piece-wise linear recurrent neural networks (RNNs)? A short thread 🧵 
In RNNs with N units with ReLU(x-b) activations the phase space is partioned in 2^N regions by hyperplanes at x=b 1/7

Bild

(1/5) Fun fact: Several classic results in the stat. mech. of learning can be derived in a couple lines of simple algebra! In this paper with Haim Sompolinsky, we simplify and unify derivations for high-dimensional convex learning problems using a bipartite cavity method. arxiv.org/abs/2412.01110

Simplified derivations for high-dimensional convex learning problems

Statistical physics provides tools for analyzing high-dimensional problems in machine learning and theoretical neuroscience. These calculations, particularly those using the replica method, often invo...

arxiv.org

i enjoyed reading the geometry of plasticity paper and felt that something important was coming, this is it:

Blake Richards@tyrellturing.bsky.social · 2y ago

Check out our new preprint! We show there is a better learning algorithm for #compneuro than gradient descent (GD): exponentiated gradients (EG). tl;dr: EG respects Dale's law, produces weight distributions that match biology, and outperforms GD in biologically relevant scenarios. 🧠📈 🧪