Maciej Gryka

@maciej.gryka.net

Software generalist with a particular interest in ML and AI. Soft spot for #ElixirLang and #Python. I enjoy challenges of early-stage startups. Ex-CTO, founded a couple companies, PhD in computer vision. More at https://maciej.gryka.net/

Well I'm sad to say it's my last week at Rainforest QA - a bunch of us got let go so if anyone is looking for incredible remote frontend (React) or backend engineers (Ruby / Rails / Python) DM me and I'll be happy to introduce you.

Woah I can really feel my decision-making ability drain in a new way now in the evenings. When most general-coding trivia is taken away, constantly facing actually challenging decisions is something else.

So it turns out, if you've got an agentic workflow build out of specific subtasks, we can probably optimize it for you and drop your LLM bill by 10x. Small, distilled models often match and sometimes outperform much larger and more expensive models on well-defined tasks.

Bild

When my agent is doing stuff and I accidentally interrupt it by pressing Esc with the terminal focused, I feel the need to apologize. Which is even dumber than usual, it doesn't perceive time!

This is excellent. I keep telling folks that the superpower of SOTA models is not that they can just generate endless amounts of code in whatever language you want, but also that they can act as a personalized engineering/coding teacher that can help you explain concepts in a way that YOU get.

Cat Hicks@grimalkina.bsky.social · 6mo ago

Key to efficient learning is realizing how we ACTUALLY learn, not just what FEELS like learning. I wrote a Claude Skill for some friends to help them think about this and they've liked it -- see Principles for some directions you could explore github.com/DrCatHicks/l...

If you don’t see the utility personally, I can get that. If I wasn’t coding I probably wouldn’t either. If you’re worried about its downsides, join the club. A lot of us are too. But no matter what your take is, take it seriously. This shit isn’t crypto.

We recently ran a project to help Knowunity cut their LLM bill by half. It’s pretty cool to beat a frontier LLM (Gemini) on all dimensions, which matter: cost, speed, and accuracy by trading off generalization, which is unnecessary here. More details www.distillabs.ai/blog/how-kno...

How Knowunity used distil labs to cut their LLM bill by 50%

We show how Knowunity use the distil labs platform to fine-tune and deploy their own models, significantly reducing their LLM costs.

distillabs.ai

Elixir's operational simplicity (having e.g. a single repo & piece of infra, compared to more moving parts in other stacks) might either be a very big advantage or not matter at all in the new coding-agent world. I'm like 75% on the side of it turning out to be important, but who knows!

Fun demo we shipped this week: AI slop detector running locally in a browser extension! github.com/distil-labs/... The utility of the tool itself is questionable :) But it was super fun to build! I was hoping to get something working in a browser for a while, and this shows how :)

GitHub - distil-labs/distil-ai-slop-detector: Detect AI-generated text locally in your browser

Detect AI-generated text locally in your browser. Contribute to distil-labs/distil-ai-slop-detector development by creating an account on GitHub.

github.com

Playing with @fly.io 's sprites by creating Claude skills to set up sprites for LiveView development. Adding Tidewave was super easy, I guess I should try LiveDebugger next. Many disposable Phoenix apps, here we come!

Over the last couple of weeks we've been working on adding tool calling support to our distillation pipelines. Now you can use it! As a fun demo, we trained a model to help you remember git commands and it's only 3B so you can run it locally! www.distillabs.ai/blog/gitara-...

Gitara: How we trained a 3B Function-Calling Git Agent for Local Use

How we created a local tool-calling language model to turn plain-English language questions into git commands with the accuracy of a cloud LLM. You can check it out in our GitHub repo or get the model...

distillabs.ai