embedding-shapes

@emsh.cat

24 passed, 3 failed https://emsh.cat/ https://github.com/embedding-shapes/

Alright, the Codex Micro just arrived! Now lets see how I can use this not with Codex but with my own harness, and hopefully also forcefully add a microphone to this device :D

Photo of the Codex Micro

It seems like #OpenAI is planning to encrypt all the prompts that #codex uses on disk, we can already not see whatever the main agent sends subagents as it's encrypted, and they're sending ciphertexts to the endpoints for inference?! What in the world?! Why would you do this? We need introspection!

It really is! Just achieved ~400 tok/s in single prompt text-generation! Text-only still, but still :) #DiffusionGemma feels like it has a really good foundation for local AI. Loading a 50GB model into VRAM + 1024 tokens inference in under 8 seconds in total, I think this changes everything :)

Stats: 1024 tokens in 2.39s (429.00 tok/s), 43 diffusion steps (18.01 it/s)
env CUDA_HOME=/opt/cuda CUDA_PATH=/opt/cuda CUDA_ROOT=/opt/cuda         cargo  5,00s user 2,41s system 99% cpu 7,454 total
embedding-shapes@emsh.cat · 2mo ago

DiffusionGemma is something else, getting +200 tok/s in my Rust implementation without even having a look at the performance, and the model is relatively clever for its size. GPU utilization is so much better than pretty much every other local model available.

DiffusionGemma is something else, getting +200 tok/s in my Rust implementation without even having a look at the performance, and the model is relatively clever for its size. GPU utilization is so much better than pretty much every other local model available.

Man, all GPT models ran via the ChatGPT subscription feels a lot dumber for the last 3-5 days, feels like they're about to release a new model

Got myself a Mac Mini so I could do CI builds of macOS apps at home. First time I left it and came back later, monitor received *something* but screen was black. Bit of troubleshooting later, turns out I hit my first macOS bug, I have barely used it! I have a feeling I'm in for a lot of fun...

Big news! Igalia (@igalia.com) is partnering with @eurosky.social to develop the next generation of the open social web. Let's stop waiting for others to fix our problems and start fixing them ourselves. We can just do things. More: www.eurosky.tech/s/Eurosky-Ig...

eurosky.tech

Sherif EA@sherif.eurosky.social · 5mo ago

I am very excited to announce our partnership @eurosky.social with @igalia.com! The partnership will accelerate the development of independent, European-operated infrastructure for the open social web, enabling developers, organizations, & communities to build new applications. cc @xanlopez.xyz

#reddit mobile app seemingly got rid of "All" and you cannot even manually go to r/all... I guess it was about when, not if, and now I've finally uninstalled reddit and will stop using it, as they clearly want less users.

How would people feel about an open source/open data alternative to myheritage/ancestry and similar family tree services? So annoying they're inaccessible unless you register, shouldn't knowledge about past people be open?

So, played around openclaw and holy shit, its an excellent demonstration of everything wrong with "modern software engineering". Errors galore, setup broke multiple times during onboarding, technical debt all over the place, zero concerns with quality, connection breaks constantly, and so much more

Agents perform 50% worse when working in a team than working alone. The setup is simple: two agents, two tasks, two VMs, and one chat channel. They then evaluated whether the merged solution from both agents passes the requirements of both tasks.

Bild

> running LLMs locally offer unparalleled room for experimentation. People are really sleeping on this, completely different experience when you can build software and just say "Fuck it, lets fire up 5 agents, then compare their work output against each other"

fry69@fry69.dev · 6mo ago

Mac Studio shine in (ab)using the vast unified memory for running LLMs locally (don't expect to run Opus 4.5 class at home though). It might still be more efficient/cheaper to rely on LLMs via APIs, but running LLMs locally offer unparalleled room for experimentation.