📢 Join us for the next UniReps x @ellis.eu speaker series event, happening on July 23rd at 4:00 PM CEST with @razvan-pascanu.bsky.social and Giulia Lanzillotta! 🚀🔵🔴
Alexandra Proca
@aproca.bsky.social
PhD student at Imperial College London, currently visiting researcher at ENS Paris. theoretical neuroscience, deep learning. aproca.github.io
1/7 Excited to share my last PhD article, just accepted to ICML 2026! In it, we (me, Alexandre Payeur, Guillaume Lajoie) used dynamical systems theory to study "local" learning in linear recurrent neural networks. See link for the paper, and thread for a brief summary. arxiv.org/abs/2606.00243
Dynamics and Representation Structure of Local Approximations to Gradient-Based Learning in Linear Recurrent Neural Networks
Biological and neuromorphic recurrent neural networks (RNNs) are subject to spatial and temporal locality constraints on the information that can plausibly be used during learning. A common strategy t...
arxiv.org
Excited to share our ICLR Oral paper, co-lead with Pratyaksh Sharma, and with @lucas-prieto.bsky.social Pedro Mediano! We study how feature geometry is shaped by memory demands in RNNs, introducing the concept of temporal superposition. openreview.net/forum?id=7cM...
How do task dynamics impact learning in networks with internal dynamics? Excited to share our ICML Oral paper on learning dynamics in linear RNNs! with @clementinedomine.bsky.social @mpshanahan.bsky.social and Pedro Mediano openreview.net/forum?id=KGO...
Learning dynamics in linear recurrent neural networks
Recurrent neural networks (RNNs) are powerful models used widely in both machine learning and neuroscience to learn tasks with temporal dependencies and to model neural dynamics. However, despite...
openreview.net
🚀 An other Exciting news! Our paper "From Lazy to Rich: Exact Learning Dynamics in Deep Linear Networks" has been accepted at ICLR 2025! arxiv.org/abs/2409.14623 A thread on how relative weight initialization shapes learning dynamics in deep networks. 🧵 (1/9)
Had a really fun time collaborating on this project with a great team. I’ll be at NeurIPs next week to present it, come by and check out our paper for more!
Kai Sandbrink@ackaisa.bsky.social · 2y agoThrilled to share our NeurIPS Spotlight paper with Jan Bauer*, @aproca.bsky.social*, @saxelab.bsky.social, @summerfieldlab.bsky.social, Ali Hummos*! openreview.net/pdf?id=AbTpJ... We study how task abstractions emerge in gated linear networks and how they support cognitive flexibility.
Thrilled to share our NeurIPS Spotlight paper with Jan Bauer*, @aproca.bsky.social*, @saxelab.bsky.social, @summerfieldlab.bsky.social, Ali Hummos*! openreview.net/pdf?id=AbTpJ... We study how task abstractions emerge in gated linear networks and how they support cognitive flexibility.