LM Studio

@lmstudio-ai.bsky.social

LM Studio Bionic is out now https://lmstudio.ai/bionic

Seen at WWDC, in a demo of LM Studio, which lets you run AI models locally: A computing cluster made up of four Mac Studios with 512GB of RAM apiece. That’s 2TB of RAM total, which is even more than 640KB.

Two Apple Mac Studio computers stacked on a wooden desk, showing the Apple logo on top, silver aluminum finish.

I was expecting this to take me a couple of hours to set up (with me getting annoyed about undocumented requirements on Github), but no, a few mins including the mini-model download. LM Studio is very beginner friendly. 🥔⚖️⭕⭕

LM Studio with DeepSeek R1 Distill Llama 8B Q4_K_M correctly answering a question about how many O's there are in PotatoLM Studio Mission Control, showing a searchable list of Models for download.

E tai, o Modelo de IA Deepseek rodando no meu MacBook Air M3 16Gb a 6 tokens por segundo LOCALMENTE. É muito simples, basta baixar o LM Studio , procurar pelo modelo, baixar (5GB) e rodar. Vc tem uma IA de ponta 100% offline rodando no seu computador Surreal.

Bild

🚀 Zed v0.170 is out! Zed's assistant can now be configured to run models from @lmstudio. 1. Install LM Studio 2. Download models in the app 3. Run the server via `lms server start` 4. Configure LM Studio in Zed's assistant configuration panel 5. Pick your model in Zed's assistant

Bild

Really enjoying local LLMs. LM Studio appears to be the best option right now. Its support for MLX-based models means I can run LLama 3.1-8b with a full 128k context window on my M3 Max MacBook Pro with 36 GB. Great for document chat, slack synopsis, and more. What is everyone else doing?

Never realised how easy it is to run LLMs locally. Thought I'd spend at least half a day to get it up and running, but with LM Studio it took me less than 15 min today. I feel like a grampa saying "I used to spend days to get Caffe running, you don't know how easy it is today!" #databs