Riccardo Grazzi
@riccardograzzi.bsky.social
Post Doc at IIT in Genoa, working on Optimization for Machine Learning and on the expressivity of LLMs
I just had the pleasure of presenting "Unlocking State-Tracking in Linear RNNs Through Negative Eigenvalues" at the AutoML Seminars. I also presented some proof sketches :) Here's the recording: t.co/B3TQozvGKX
https://youtube.com/watch?v=E2qBhMmjspU
t.co
Excited to present "Unlocking State-Tracking in Linear RNNs Through Negative Eigenvalues" at the M3L workshop at #NeurIPS https://buff.ly/3BlcD4y If interested, you can attend the presentation the 14th at 15:00, pass at the afternoon poster session, or DM me to discuss :)
Unlocking State-Tracking in Linear RNNs Through Negative Eigenvalues
Linear Recurrent Neural Networks (LRNNs) such as Mamba, RWKV, GLA, mLSTM, and DeltaNet have emerged as efficient alternatives to Transformers in large language modeling, offering linear scaling with…
buff.ly
At #NeurIPS2024 🇨🇦 our group will present 7 contributions! These span a diverse array of topics: from theoretical advances in stochastic processes and reinforcement learning to applications in molecular dynamics and uncertainty quantification.