Tim Davidson

@imtd.bsky.social

🌐 https://www.trdavidson.com 🔬research: deep generative learning; agentic systems; synthetic data PhD @EPFL on reliable magic Spent time @MSR, @Google machine learning & company building 🎓@NYU @UvA alumn

A dream come true! I presented "No Representation, No Trust" on my favorite RL podcast, TalkRL! Make sure to check it out to learn why training with PPO for too long makes your agent collapse!

Robin Ranjit Singh Chauhan@robinchauhan.bsky.social · 2y ago

E63: NeurIPS 2024 - Posters and Hallways 1 Jiaheng Hu of UTexas on Unsupervised Skill Discovery for HRL @skandermoalla.bsky.social of EPFL: Representation and Trust in PPO Adil Zouitine of IRT Saint Exupery/Hugging Face : Time-Constrained Robust MDPs

🔥 Want to train large neural networks WITHOUT Adam while using less memory and getting better results? ⚡ Check out SCION: a new optimizer that adapts to the geometry of your problem using norm-constrained linear minimization oracles (LMOs): 🧵👇

Bild

I am in Vancouver for NeurIPS 2024 until December 16th if you want to meet, DM or email me. We have two accepted papers from my lab: 1. Building on Efficient Foundations: Effective Training of LLMs with Structured Feedforward Layers, on Wednesday, East Exhibit Hall A-C #2010 (1/3)

Better VQ-VAEs with this one weird rotation trick! I missed this when it came out, but I love papers like this: a simple change to an already powerful technique, that significantly improves results without introducing complexity or hyperparameters.

Bild
Post nicht verfügbar.