Carl Allen
@carl-allen.bsky.social
Laplace Junior Chair, Machine Learning ENS Paris. (prev ETH Zurich, Edinburgh, Oxford..) Working on mathematical foundations/probabilistic interpretability of ML (what NNs learn🤷‍♂️, disentanglement🤔, king-man+woman=queen?👌…)
How do tokens evolve as they are processed by a deep Transformer? With José A. Carrillo, @gabrielpeyre.bsky.social and @pierreablin.bsky.social, we tackle this in our new preprint: A Unified Perspective on the Dynamics of Deep Transformers arxiv.org/abs/2501.18322 ML and PDE lovers, check it out!
Machine learning has made incredible breakthroughs, but our theoretical understanding lags behind. We take a step towards unravelling its mystery by explaining why the phenomenon of disentanglement arises in generative latent variable models. Blog post: carl-allen.github.io/theory/2024/...
If few-shot transfer is ur thing!
Ivana Balazevic@ibalazevic.bsky.social · 2y agoWe maintain strong zero-shot transfer of CLIP / SigLIP across model size and data scale, while achieving up to 4x few-shot sample efficiency and up to +16% performance gains! Fun project with @confusezius.bsky.social, @zeynepakata.bsky.social, @dimadamen.bsky.social and @olivierhenaff.bsky.social.
Just wondering (very neutrally!)… if authors have to review as a condition of submitting themselves, but they then review in *clear bad faith*, should their own submissions be rejected as if they had not reviewed? 🤔 #ICLR2025 @iclr-conf.bsky.social
The Country Land and Business Association says the new ÂŁ1m cap on agricultural inheritance tax relief will "harm 70,000 farms". That's 1/3 of all farms. What does the actual data show? Less than 500 farms/year will be pay more tax as a result of this change every year. Possibly as few as 100.
