Yasser Souri
@yassersouri.bsky.social
Senior Applied Scientist - Microsoft (Opinions are my own) Ex: Google Research PhD intern https://yassersouri.github.io
I remember when I saw the ICML 2015 test of time award winner, I noticed the paper "Learning to Rank Using Gradient Descent" for the first time. Then I got the idea for the "Deep Relative Attributes" paper.
#ICML2025 Test of time award is likely going to the Batch Normalization paper.
#ICML2025 Test of time award is likely going to the Batch Normalization paper.
A while back when Sam Altman was in India he was asked whether a team with around $10 M could build something to compete with OpenAI and Sam Altman said it was "hopeless". Deepseek-V3 with around $6 M cost for the pre-training run just released a model with very high capability (on benchmarks)
It is sad to see authors not being able to present their work at #NeurIPS2024 because of visa issues. But some authors went above and beyond. Here is @hadivafaii.bsky.social tele-presenting his work with an impressive setup (ipad, mic, speaker, holder, battery). Well done sir!
#NeurIPS2024 (@neuripsconf.bsky.social) Day 2 (Wednesday) Experience One of the great things about conferences like NeurIPS is that you get to see people who you admire for different reasons. I also got to see and talk to some. Really happy I got to talk to William Agnew.
#NeurIPS2024 (@neuripsconf.bsky.social) Day 1 Experience There were a bunch of interesting Tutorial, Talks and events today at NeurIPS. But definitely the highlight of the day was catching up with friends and current and past colleagues and seeing folks.
Ilya Sutskever has won 3 test of time awards at NeurIPS now! 2022: for AlexNet paper 2023: for word2vec paper 2024: for Seq2Seq paper
Excellent explanation of RoPE embedding, from scratch with all the math needed: https://fleetwood.dev/posts/you-could-have-designed-SOTA-positional-encoding And with beautiful 3blue1brown's style of animation: https://github.com/3b1b/manim. Original RoPE paper: arxiv.org/abs/2104.09864
Both won 👏 blog.neurips.cc/2024/11/27/a...
Announcing the NeurIPS 2024 Test of Time Paper Awards – NeurIPS Blog
blog.neurips.cc
Which paper is going to win the #neurips2024 test of time award? GAN by @ian-goodfellow.bsky.social et. al. or the famous Sequence to Sequence learning paper from Ilya Sutskever and others? Or maybe some other paper which I cannot recall?
NeurIPS Conference is now Live on Bluesky! -NeurIPS2024 Communication Chairs
Interested in RLHF, DPO, LLM alignment? I've just created this list featuring awesome people like @natolambert.bsky.social . The list is the opposite of exhaustive; I've just joined some days ago 😅 go.bsky.app/MqRGAf2
For a while I used pipenv and poetry for managing python projects. After a while I tried "uv" and I am never going back. BTW, here is a doc on using uv and pytorch: docs.astral.sh/uv/guides/in...
PyTorch | uv
docs.astral.sh
Borealis AI used to make the coolest t-shirts for ML conferences, they used to have a shirt with “yes we GAN” on it, another one with “ganaca”!
Which paper is going to win the #neurips2024 test of time award? GAN by @ian-goodfellow.bsky.social et. al. or the famous Sequence to Sequence learning paper from Ilya Sutskever and others? Or maybe some other paper which I cannot recall?