Camilla Montonen

@spimescape.bsky.social

machine learning engineer lost in the world of databases

Compression and LLMs are trying to solve the exact same problem: predicting what comes next. @anniesexton.com's interactive essay walks us through the basics of compression to reveal its surprising overlap with every language model you've ever used.

Anyone have recommendations for user-friendly or even semi-user friendly GPU platforms where I could spin up a vLLM server without breaking the bank? Tried Modal, but my container image builds are breaking :(.

Logged off of Twitter for prob the last time. It's not a place I've wanted to be for a long time. Even if you ignore all the other bullshit (and you shouldn't), the public tech agora of the 2010-2020 era is gone now. I miss the conversations. I hope they will continue somewhere in some form.

The fact that Claude allows me to be fairly productive (on small matters) in a codebase written in a language (Rust) that I have very little experience with is a small miracle. The downside is that I can only be productive in this codebase with Claude. If Claude is not working, neither can I.

I’ll bite. A machine that: 1. Experiences the world with us 2. Shares some truth-interest in the world (intellectual integrity & curiosity) 4. Forms ideas rather than barfs up chunks of algorithmically masticated text 5. Created to complement rather than devalue human intelligence and creativity

modern LLM inference engines like vLLM & SGlang are becoming tough to dive into. to learn how these inference engines work, nano-vllm is a fantastic educational project—complete Page Attention & LLM scheduler in <1k loc.🤯 flaneur2020.github.io/posts/2025-1...

A Walkthrough of nano-vllm | Flaneur2020

Recently, I&rsquo;ve been delving into the architecture of production-grade inference engines. While projects like vLLM and SGLang are crazy sophisticated, …

flaneur2020.github.io

Me after hearing that Python 3.14 has removed the GIL: "ah, finally increased throughput of pulling data from Big Query into my Jupyter notebooks." Also me: "ah, a new footgun to add to my repertoire"