In our latest ⛈️ Thunder Session ⛈️ episode, @lantiga.bsky.social and I discuss memory usage but also the our broader goals with Thunder. Watch the full session at youtu.be/wJHQropKI84 . This Friday we will have the 20th episode, it will be very special epsiode again. Can't wait to see you there!
*A Journey into PyTorch, the Ecosystem, and Deep Learning Compilers* Great seminar by @lantiga.bsky.social on the compiler's ecosystem and the recent Thunder framework by LightningAI! I have uploaded slides, video, & notebooks publicly. 🙂 www.sscardapane.it/seminars/pyt...
So I’ve been hacking on PyTorch Lightning lately, having a great time prepping the next release Here’s how FP8 + FSDP2 + torch.compile is going to look like: