Rasmus Aagaard

@rasgaard.com

Industrial PhD Student @ Laerdal.com & DTU.dk, research in efficient machine learning, edge deployment and model compression

The Danish Foundation Models (DFM) project is adapting our modular FlexOlmo architecture into a lighter-weight system that runs on commodity hardware—putting collaborative model building within reach of smaller research groups & organizations. 🧵

Bild

Got an extended abstract paper accepted at the GLOW workshop at IJCAI :) Turns out you can just delete 6 layers from the Whisper encoder and it doesn’t hurt transcription performance all that much (but you have to be pretty specific about which layers)

Bild

Seeing how SOTA models are evolving: becoming more restrictive in usage (decided by the company), less transparent (you cannot tell if the AI lab nerfed your model) + less private (your prompts are stored, no opt out) makes me much more interested in open models + local inference

Very strongly recommend breaking out of the token discourse and touching grass from time to time to maintain a grip on reality

What Is Art For?
BOWIE'S BOOKSHELF
THE HUNDRED BOOKS THAT CHANGED DAVID BOWIE'S LIFE
JOHN O'CONNELL
The Beauty of Everyday Things
Soetsu Yanagi
THE POCKET POETS SERIES
LUNCH POEMS
by
Frank O'Hara
SECOND EDITION
DICTIONARY OF SUBJECTS AND SYMBOLS IN ART
JAMES HALL Introduction by Kenneth Clark
ABER NINETEEN

Legitimately feels like an unquantifiable vibe shift the last few weeks where the pendulum is swinging back to reasonable takes and people experimenting with model choice 🙏

Top HN headlines over the past 24 with reasonable takes like “Local AI needs to be the norm” and “I’m going back to writing code by hand”

We've recently implemented the fastest static embedding model in the world by an insanely large margin Read on for additional info ↓

Bild

Researchers identifies "Super Weights" which are at most a handful of weights (amongst billions!). Models end up generating complete gibberish if these weights are removed, underlining the brittleness of LLMs and importance and careful consideration of outlier features. arxiv.org/pdf/2411.07191

BildBild

LLM cloud inference dominates usage, but should it? Local models and accelerators have improved massively over recent years. Perfect routing to best local model "reduce energy consumption by 80.4%, compute by 77.3%, and cost by 73.8% versus cloud-only deployment" arxiv.org/pdf/2511.07885

BildBild

Introducing ✨Tiny Aya✨, a family of massively multilingual small language models built to run where people actually are. Tiny Aya delivers strong multilingual performance in 70+ global languages in a 3.35B parameter model, efficient enough to run locally, even on a phone.