Mart Roosmaa

@roosmaa.net

📸 Photography | 👨‍💻 Programming (Go, Rust) & homelab (k8s) | 📺 Anime | 🪛 3D printing & electronics | 🎮 Gaming He/him.

It's low key infuriating when the model [Q38FN] doesn't trust the stuff you copy-paste into it, after you run the commands it asked you. But if it runs the same commands via tool calls, it doesn't second-guess itself at all.

OpenCode web frontend seems to be a good replacement for OpenWebUI. At least I haven't visited the OpenWebUI tab even once after setting up a permanent OpenCode tab.

Now that local AI has become useful on Strix Halo, I'm low key regretting not buying several Framework Desktops last year. Don't get me wrong, even at €2k it was already a bit too expensive for my liking. But the prices now.. ugghhh! They're just obscene.

I've decide pi.dev is not for me at this time. I was hoping to set it up in a way that was "optimized" for a single local model, but most of the exciting extensions out there aren't built with that in mind. And I don't want to spend time reinventing the wheel at this time.

I'm trying out Pi.dev. On paper it looks exciting, in reality I'm starting to think there's a significant learning curve in getting it to a place for optimal outputs.

A week ago, I decided to vibe-build a wetranfer clone completely offline with a local AI model. Today I deployed it on production. It blows my mind that my Framework Desktop could do something like this. Even 6 months ago, the local models weren't this capable nor this speedy.

I'm showing my age here... but leaving the computer on so that the agent could work throughout the night, reminds me of dial-up times when you left the computer on during the night to download something. In both cases you have something to look forward to in the morning.

The initial version of the wetransfer clone I vibe-built with my local agent looked like 💩️ to be expected as I didn't specify any design criteria. Now, it just finished redesigning it, and it looks much better. It's not perfect, nor flashy. But I can live with it.

Landing page for vibe-built wetransfer cloneUpload files page for vibe-built wetransfer cloneDownload via link page for vibe-built wetransfer clone

Turned on sound notifications for tool call prompts. My computer sounds like a Christmas jingle now. I guess it's time to get into the holiday spirits 🎄⛄

I realise I'm about 2 years behind the initial hype, but the spec based approach to vibing seems to work pretty darn well on my local Qwen 3.8 Flash Next model.

It's done and I'm super impressed. I intentionally let it run mostly unsupervised and it managed splendidly. Everything not to my liking was things that I didn't explicitly specify, so it's on me. I'm convinced, the age of local AI is here. Now if only the hardware prices came back down to earth.

Mart Roosmaa@roosmaa.net · 2w ago

Now I'm in the middle of vibe-building a simple wetransfer clone [in Rust] to evaluate it more in depth. After 2 evenings of reviewing tool-calls, it's at step 8 of the implementation plan. I'll report back with my final impressions when it has finished all of the 37 steps.

As I was talking with my local LLM, my daughter looked at my screen and asked who I was chatting with. I replied "with the computer". "With someone on the internet?" she asked.

Last week, I was catching up on my notification emails and saw some discussions about new local AI projects targeting Strix Halo platform in Framework community forums. Mainly halogen and gufo.

I have an indian vegetarian cook book that I bought some years back. Every single recipe that I'd like to try from it has at least one impossible to source ingredient...

As I'm getting back into making bread at home, I stocked up on some nice organic flour. Have to figure out where to store all 10kg of it, but I'm already excited for my next bake!

Two 5kg bags of flour

Made some shokupan for the starting week. Going to use home made turkey ham and cranberry sauce to make some delicious sandwiches as soon as it cools down! 😋

Freshly out of oven Japanese Milk Bread cooling on a makeshift rack.

My 5yro has figured out how to reliably get past the screen time limiter on Xiaomi TV Box S. On one hand I'm truly proud of that little hacker, on the other hand I'm looking for solutions to workaround the buggy Xiaomi code.

Discovered that Bleach has 3 new seasons I was oblivious of (1000 year blood war), so I've been binging them non-stop. The art style has gotten slight tweaks, but overall it's still following the original Bleach formula. Loving it!

I got a craving for some chocolate chip cookies yesterday. Googled for a recipe and threw it together. Only after I had put the dough into the fridge to wait for the morning did I notice that the recipe I was following had been generated by AI.

This Christmas vacation I'm tackling the backlog of my Steam library. Some of it at least. The winter sale has already managed to grow it quite a bit.