Daniele

@lupodevelop.bsky.social

punk attitude, enthusiast coder. gleam, rust, python, ts - mostly experiments. my github reflects the process. 💻 https://github.com/lupodevelop 🫰🏻 https://ko-fi.com/lupodevelop 🌐 altumdream.com 🌐 amanitaproject.com

Why are we allowing vector DBs to camp on GB of RAM? 🤯 skeg is a disk-first, vector engine built in Rust. Full vectors on SSD; quantized set stays in RAM. The 100K benchmark: skeg: 47MB | 1.0 Recall | 2.5ms • Qdrant: 885MB RAM | 0.997 Recall | 2.6ms 👉 github.com/skegdb/skeg

GitHub - skegdb/skeg: A multi-tenant vector database focused on extreme RAM efficiency. Lightweight, scalable, and optimized for high-density deployments.

A multi-tenant vector database focused on extreme RAM efficiency. Lightweight, scalable, and optimized for high-density deployments. - skegdb/skeg

github.com

Three skeg instances. Three separate corpora. One answer. The federation layer queries each instance independently. No central store. Each agent keeps its own memory, partitioned, on its own footprint. RAG without collapsing everything into one bucket. Running on an MacBook Pro M1 with 16GB.

Today's schedule is a bit lighter than yesterday's. 🐕 Let's start with the 1.8.0 release of Woof (a logging library for Gleam). 🎁 Then I have a promise to keep. And yes, it's about the TUI library... ⚓ Has anyone had a chance to check it out, Skeg?

Tired of vector DBs killing your RAM? Skeg is made for big LLMs on the same machine. - 1M vectors → ~400 MB RAM - 1-4 bit quantization + reranking - Fast Rust Long-term memory for your agent without downgrading the model. github.com/skegdb/skeg #LocalLLM #RAG #AI #Agents

GitHub - skegdb/skeg: Vector database for AI agents. Context layer, multi-tenant, RAM-frugal. Runs anywhere your model runs.

Vector database for AI agents. Context layer, multi-tenant, RAM-frugal. Runs anywhere your model runs. - skegdb/skeg

github.com

1M vectors. 419 MiB RSS. recall@10 ≥ 0.998. p99 < 4ms. qdrant-hnsw needs 4162 MiB for the same corpus. skeg does it in one tenth. disk-resident Vamana index, SIMD NEON kernels, PQ + int8 + TurboQuant tiers. built for Apple Silicon M1 alongside a running LLM.

Daniele@lupodevelop.bsky.social · 2mo ago

I know. You've been waiting for my TUI for Gleam. But hey, I've released Skeg, a RAM-efficient context layer. github.com/skegdb/skeg I'll make it up to you soon.