François Fleuret
@francois.fleuret.org
Research Scientist Meta/FAIR, Prof. University of Geneva, co-founder Neural Concept SA. I like reality. https://fleuret.org
I asked "on the other platform" what were the most important improvements to the original 2017 transformer. That was quite popular and here is a synthesis of the responses:
"You are in Paris, enjoy the city, stop obsessing with AI" Paris:
Maybe the wall was the friends we made during that journey Ted.
Ted Underwood@tedunderwood.com · last yr.The year is 2435. Human beings — now sentient spheres of glowing gas — finally understand why matter exists. Our knowledge of the world is complete, and can go no farther! One the telepresence screen, a simulation of a 21c internet pundit pops up: "Told you deep learning was hitting a wall!"
What is the true depth of an LLM? Together with @danielepal.bsky.social , @matpagliardini.bsky.social, M. Jaggi and @francois.fleuret.org we show that LLMs have a smaller effective depth that can be exploited to increase inference speeds on multi-GPU settings! arxiv.org/abs/2502.02790 (1/N)
J'étais l'invité du journal de 19h30 sur la @radiotelesuisse.bsky.social ce soir pour parler d'Intelligence Artificielle. www.rts.ch/play/tv/19h3...
19h30 - Play RTS
Play RTS vous permet de visionner ou d'écouter de nombreuses émissions tv ou radio, quand et aussi souvent que vous le souhaitez.
rts.ch
It is hard to overstate how cool and powerful is flex attention. @chhillee.bsky.social pytorch.org/blog/flexatten… TL;DR: it is an implementation of the attention operator in pytorch that allows in particular to efficiently "carve" the attention matrix. 1/3
pytorch.org
Happy new year you all! 2025 is certainly full of promise.
Whatever you say about the whole field of AI: It's not boring.
You young post-2012 researchers, you realise that us the old people are *amazed* by what we witness?
Something that annoys me much is when people (generally in political / "societal" discussions) equate the validity of a statement with the validity of *what "people" may understand* and generally then fix a true statement they consider false with a false statement they consider true. 1/2
hello bluesky! we have a new preprint on solvation free energies: tl;dr: We define an interpolating density by its sampling process, and learn the corresponding equilibrium potential with score matching. arxiv.org/abs/2410.15815 with @francois.fleuret.org and @tbereau.bsky.social (1/n)
"The expletive error rate is the number of times you call your algorithm a 'dense mf' when looking at one run"
General structure of a paper: - general ideas - general case - general case - general case - what we actually do how it should be: - what we actually do - why we think it's great as one method of a general class - how we got there - how we got there - how we got there
One of the goosebumpsiest short movie ever (where this quote comes from). We will have this sound snippet played at the ceremony when we will leave earth for the stars. www.youtube.com/watch?v=YH3c...
Wanderers - a short film by Erik Wernquist [Official Version]
YouTube video by Erik Wernquist - Digital Artist
youtube.com
François Fleuret@francois.fleuret.org · 2y ago"We invest far-off places with a certain romance. This appeal, I suspect, has been meticulously crafted by natural selection as an essential element in our survival."
"We invest far-off places with a certain romance. This appeal, I suspect, has been meticulously crafted by natural selection as an essential element in our survival."
If you have not seen it, you really should. m.youtube.com/watch?v=WXuK...
AlphaGo - The Movie | Full award-winning documentary
YouTube video by Google DeepMind
m.youtube.com
Just gave a talk on "Grounding LLMs in Code Execution" at the NeurIPS Hacker-Cup AI Competition, here are the slides docs.google.com/presentation...
[NeurIPS HackerCup 2024] Grounding LLMs in Code Execution
Grounding LLMs in Code Execution Gabriel Synnaeve, Meta, FAIR
docs.google.com
My political weight is obviously immense since there is coffee available all the time at @neuripsconf.bsky.social this year. For next year: can we have at e.g. 10 places in the center some huge colorful discs with numbers 1...10 in them to serve as convenient meeting points?
