Ferenc Huszár
@inference.vc
Secular Bayesian. Professor of Machine Learning at Cambridge Computer Lab Talent aficionado at http://airetreat.org Alum of Twitter, Magic Pony and Balderton Capital
NeoLabs are the new AltCoins, seed rounds the new ICO. DeepMind is BitCoin OpenAI Ethereum Anthropic Solana xAI is DogeCoin There are some that will find specialised niches, others who are actual businesses. Most can't be bothered and are probably mainly Ponzi. Won't stop people investing..
me: Yay! I'm running my own company now, I am no longer forced to use Microsoft Teams for meetings. also me: *waiting to join the third Teams call of the day, this time with our law firm*
I think GPT now do some new kind of personalization. I once asked it to roleplay as a pirate ghost for a kid’s escape room game, now it writes me Deep Research essays with pirate ghost lingo thrown in. It’s the “Spotify mixing in nursery rhymes in my gym playlist” problem all over again.
In the distant future, our European children may rediscover a usable internet after all.
Michael Hoffman@michaelhoffman.bsky.social · 9mo agoFricking finally www.theverge.com/news/823788/...
Mathematical breakthrough of the year: Financial Times finally calculating the normalizing constant of the uniform distribution over ALL outcomes.
I’m very bad at getting things done but pretty good at making things happen. 🤷🏽♂️ How does this work?
My favourite vegan cream substitute is pasta water. Not only does it work better for pasta sauces, it reduces risk of death by assassination after your Italian friends learn that you put cream in carbonara…
Thinking Machines co-founder Andrew Tulloch reported/rumoured to receive £3.5bn pay package over 5 years to rejoin Meta. To put this into perspective, this would approximately cover Armenia's entire education budget (over the next 5 years). Not accounting for income/capital gains taxes of course.
Just realised how hopeless and inadequate it feels when - accidentally - I google for information instead of asking ChatGPT (equivalent). Context: I was looking for a bedtime reading book that is complex, for preteens but structured as a collection of stand-alone episodes rather than one long novel
When I applied to PhDs, I could derive the E-M algo after 5 yrs of uni and I felt I stood out. Many applicants didn’t do much ML before. This year, Miranda, barely out of high school starts her undergraduate with a NeurIPS spotlight, two AI olympiad medals, having bern to EEML 2x plus AI retreat 😨
I like the sound of this common EU corporate entity idea! Except quite clearly the virtual state shouldn’t be called “regime 28” but “regime 0” or failing that, “regime -1”. Open for consultation until 30 Sept so take a look! www.eu-inc.org
EU–INC — One Europe. One Standard. — Pan-European legal entity.
EU–INC is a proposal for a pan-European standardized legal entity to unlock pan-European startup scaling.
eu-inc.org
Like a phoenix rising from the ashes, like a turd that wouldn’t flush, I re-emerge again in the geriatric Millennial basketball scene. Wish me good health.
Mom, can we watch Star Wars? Mom: We have Star Wars at home Star wars at home:
I wrote an op-ed on the world-class STEM research ecosystem in the United States, and how this ecosystem is now under attack on multiple fronts by the current administration: newsletter.ofthebrave.org/p/im-an-awar...
I’m an award-winning mathematician. Trump just cut my funding.
The “Mozart of Math” tried to stay out of politics. Then it came for his research.
newsletter.ofthebrave.org
Arrived in Sarajevo for @eemlcommunity.bsky.social Located in a narrow valley, it’s an ideal setting to get the momentum going in my deep learning talk later. I’m keen to explore beyond the hotel coffee though which, one assumes, is carefully curated to highlight floral notes of a morning cigarette
So you want to skip our thinning proofs—but you’d still like our out-of-the-box attention speedups? I’ll be presenting the Thinformer at two ICML workshop posters tomorrow! Catch me at Es-FoMo (1-2:30, East hall A) and at LCFM (10:45-11:30 & 3:30-4:30, West 202-204)
Annabelle Michael Carrell@ab-carrell.bsky.social · last yr.Your data is low-rank, so stop wasting compute! In our new paper on low-rank thinning, we share one weird trick to speed up Transformer inference, SGD training, and hypothesis testing at scale. Come by ICML poster W-1012 Tuesday at 4:30!
BREAKING: OpenAI point guard Jason Wei joins Meta in shocking trade news. OpenAI receives two ConvNet researchers and a 2027 first-round draft pick. Veteran Yann LeCun rumored to be missing another season due to slow Achilles recovery. Apple “cautiously optimistic” about G-league chances.
Your data is low-rank, so stop wasting compute! In our new paper on low-rank thinning, we share one weird trick to speed up Transformer inference, SGD training, and hypothesis testing at scale. Come by ICML poster W-1012 Tuesday at 4:30!
Lester Mackey@lestermackey.bsky.social · last yr.New guarantees for approximating attention, accelerating SGD, and testing sample quality in near-linear time
Low-Rank Thinning is presented tomorrow at ICML ⏰ Tue 15 Jul 4:30 - 7 p.m. PDT icml.cc/virtual/2025...
ICML Poster Low-Rank ThinningICML 2025
icml.cc
Ferenc Huszár@inference.vc · last yr.Off to ICML next week? Check out my student Annabelle’s paper in collaboration with @lestermackey.bsky.social and colleagues on low-rank thinning! New theory, dataset compression, efficient attention and more: arxiv.org/abs/2502.12063
Off to ICML next week? Check out my student Annabelle’s paper in collaboration with @lestermackey.bsky.social and colleagues on low-rank thinning! New theory, dataset compression, efficient attention and more: arxiv.org/abs/2502.12063
Low-Rank Thinning
The goal in thinning is to summarize a dataset using a small set of representative points. Remarkably, sub-Gaussian thinning algorithms like Kernel Halving and Compress can match the quality of unifor...
arxiv.org
There once was a good man called Frederik He landed a sweet job in Limerick For fifty-six grand He would teach on command "Entschuldigung", "Tschüss" and "Ich liebe dich"
Been awesome to meet @number10cat.bsky.social earlier today! My hero, the only constant among all the turmoil. Having served under 6 prime ministers, Olympics, Brexit. Loyal to no one, doesn’t give a fur ball about anything: the perfect role model for gen Z.
Rich get richer The three emerging hubs for frontier AI jobs and wealth creation in Europe -- London - Zürich - Paris -- have already been the wealthiest cities in Europe by per capita GDP, wages and wealth. Are there examples of newfound wealth creation by AI anywhere? Maybe UiPath in Bucharest?
Weymo is an interesting experience. Because there's no driver, every ride feels like it's the driver. Feels a bit like a loyal pet, because it's obviously not a person but has agency and your attribute some level of personality to it. A bit sad to let them go when a ride is over.
Are you in your 30s and being offered more than the entire f*ing LA Lakers for superintelligence research? Take my advice: Get a notebook and write down all the hyperparameters and random details you still remember. Your memory wont be getting any better as you age.
