🚀 An other Exciting news! Our paper "From Lazy to Rich: Exact Learning Dynamics in Deep Linear Networks" has been accepted at ICLR 2025! arxiv.org/abs/2409.14623 A thread on how relative weight initialization shapes learning dynamics in deep networks. 🧵 (1/9)
Check out our #NeurIPS2024 spotlight "Get rich quick: exact solutions reveal how unbalanced initializations promote rapid feature learning." Thu 12 Dec 4:30-7:30 pm East Exhibit Hall A-C #2102 Paper: arxiv.org/abs/2406.06158 Thread: x.com/KuninDaniel/...
Get rich quick: exact solutions reveal how unbalanced initializations promote rapid feature learning
While the impressive performance of modern neural networks is often attributed to their capacity to efficiently extract task-relevant features from data, the mechanisms underlying this rich feature le...
arxiv.org
Come check out our #NeurIPS2024 spotlight poster on feature learning tomorrow! 📍 East Exhibit Hall A-C #2102 📅 Thu 12 Dec 4:30 p.m. — 7:30 p.m. PST 📝 arxiv.org/abs/2406.06158
Had an amazing time with @marcofm.bsky.social @danielkunin.bsky.social @david-klindt.bsky.social and Feng Chen doing science 🧑🔬 and surfing 🌊 in Santa Barbara for the Follow-on Program at the Kavli Institute for Theoretical Physics! 🌴 #ScienceAndSurf #KITP
