Had so much fun co-authoring the MCP Apps spec and helping launch it in claude.ai! 🎉 blog.modelcontextprotocol.io/posts/2026-0...
Claude
Talk with Claude, an AI assistant from Anthropic
claude.ai
Olivier Chafik
@ochafik.bsky.social
Work @ Anthropic on MCP (views expressed = my own) former Googler & OpenSCAD & llama.cpp contributor. Just wish I'd learned Rust he/him 🏳️🌈 Also found at: @ochafik@fosstodon.org (Slowly moving out of https://x.com/ochafik)
llama.cpp streaming support for tool calling & thoughts was just merged: please test & report any issues 😅 github.com/ggml-org/lla... #llamacpp
`server`: streaming of tool calls and thoughts when `--jinja` is on by ochafik · Pull Request #12379 · ggml-org/llama.cpp
This PR is still WIP (see todos at the bottom) but welcoming early feedback / testing Support streaming of tool calls in OpenAI format Improve handling of thinking model (DeepSeek R1 Distills, QwQ...
github.com
Llama.cpp now supports tool calling (OpenAI-compatible) github.com/ggerganov/ll... On top of generic support for *all* models, it supports 8+ models’ native formats: - Llama 3.x - Functionary 3 - Hermes 2/3 - Qwen 2.5 - Mistral Nemo - Firefunction 3 - DeepSeek R1 🧵 #llamacpp
Tool call support (generic + native for Llama, Functionary, Hermes, Mistral, Firefunction, DeepSeek) w/ lazy grammars by ochafik · Pull Request #9639 · ggerganov/llama.cpp
This supersedes #6389 (now using a fully C++ approach), #5695 (first attempt at supporting Functionary) and #9592 (more recent Python wrapper). Which models are supported (in their native style)? W...
github.com
Universal llama.cpp tool call is coming: I've just released Minja, a minimalistic Jinja template engine reimplementation in C++ for LLM chat templates: github.com/google/minja (*not an official Google product*) #LLM #AI #EdgeAI #OSS 🧵 1/4
GitHub - google/minja: A minimalistic C++ Jinja templating engine for LLM chat templates
A minimalistic C++ Jinja templating engine for LLM chat templates - google/minja
github.com
#Manifold v3.0 is out! This is a huge release - we have removed *all* required dependencies. Our npm package is half the size and twice the speed. Our #SDF LevelSet is much faster and higher quality. And so much more: github.com/elalish/mani...
