Learn how I built a self-hosted dashboard for monitoring local vLLM and llama.cpp inference servers. It brings together GPU and VRAM utilization, model health, runtime configuration, cache details, and interactive performance benchmarks in one local-
Local vLLM and llama.cpp Dashboard
Introduction Over the last several months I have been doing a bit of experimentation locally hosted LLMs, primarily with vLLM, llama.cpp, different quantization methods, GPU configurations, and models. My overall goal is a smart enough local agent that can code and troubleshoot, and ask smarter frontier models for help/review. Part of this journey has been […]
chrispaquin.com
