I started a new series of tutorials about running LLMs locally on a Mac with MLX. The first tutorial is out, working on the next 3 ones 👇🏼 If you want to get a sneak peek, please check this repo: github.com/RamiKrispin/...
Rami Krispin
@ramikrispin.bsky.social
Senior Manager Data Science and Engineering at | Docker Captain 🐳| Time-series analysis & forecasting My newsletters: Weekly updates: https://ramikrispin.substack.com AIOps: https://theaiops.substack.com Forecasting: https://theforecaster.substack.com
My weekly newsletter is out! 🔹 Open Source - Google Research's new project: Regularized Recursive Self-Improvement 🔹 New learning resources - MLA, Fledge Alpha, Jev decision models 🔹 Book of the week - AI Agents with MCP by @kylestratis.com ramikrispin.substack.com/p/self-impro... #ai #datascience
Self-Improving Agent Harnesses, AI Agents with MCP | Issue 109
Explore RRSI for improving agent harnesses, new resources on attention, decision models, and API design, and AI Agents with MCP by Kyle Stratis.
ramikrispin.substack.com
I just published a new tutorial in my Docker 101 series for AI/ML developers. Building and running an image confirms that the application works, but inspection reveals the metadata and runtime defaults that Docker stored in the artifact 👇🏼 theaiops.substack.com/p/how-to-ins... #ai #docker #aiops
How to Inspect a Docker Image
Learn how to inspect a Docker image, read its metadata and runtime configuration, and view its build history and filesystem-layer identifiers.
theaiops.substack.com
Google released EmbeddingGemma 2 - a new multimodel embeddings open weights model. Looks supper cool 👇🏼 www.youtube.com/watch?v=anPs...
Introducing EmbeddingGemma 2: An open model for natively multimodal embeddings
YouTube video by Google for Developers
youtube.com
Issue 108 is out! This week’s agenda: 🔹Open Source of the Week - ShinyReact 🔹New learning resources - LangSmith, specialist agents, software factories, and building agents in Python 🔹Book of the week - RAG with Python Cookbook by Dominik Polzer ramikrispin.substack.com/p/react-inte... #rstats #ai
ShinyReact and RAG with Python | Issue 108
Explore ShinyReact for React-based Shiny interfaces, resources on production agents and software factories, and RAG with Python Cookbook by Dominik Polzer.
ramikrispin.substack.com
AI will find a cure for cancer. We need to invest in infrastructure and build more data centers. Meanwhile, what AI is actually doing 👇🏼 Video credit: unknown
If you are not familiar with the MLX Fast project, you should check it out. MLX Fast is a competition to make the same #AI model run faster on Apple Silicon by optimizing the inference engine rather than changing the model itself. 🧵👇🏼
My physical copy of AI Agents with MCP showed up...it's real! You can order the ebook now, and the print edition should be shipping soon, with pre-orders open. Over 330 pages on the Model Context Protocol, up to date with the July spec rewrite and Python SDK v2. kylestratis.com/books/ai-ag...
A new tutorial in my SQL AI Agents series 👇🏼 I recently started a new series of tutorials that focuses on SQL AI agents in my newsletter 🗞️. This series is beginner-friendly, starting from the foundation all the way to production. ramikrispin.substack.com/p/prepare-da... #ai #sql #python
Prepare data for a SQL AI agent with DuckDB and Ibis
Prepare SFO passenger data for a SQL AI agent, create a persistent DuckDB table through Ibis, and validate it with native SQL.
ramikrispin.substack.com
My weekly newsletter is out! This week: 🔹Open Source of the Week - Paperclip 🔹New learning resources 🔹Book of the week - Work Automation with R by Tiger Tang ramikrispin.substack.com/p/paperclip-... #ai #datascience #rstats #opensource
Paperclip Agent Orchestration, Work Automation with R | Issue 107
A weekly curated update on data science and engineering topics and resources.
ramikrispin.substack.com
My LinkedIn Learning course, SQL AI Agents in Production, is available for free for a limited time at the link below: www.linkedin.com/feed/update/... #ai #datascience #sql #python
My recent LinkedIn Learning course, SQL AI Agents in Production, just reached 4,000 learners 🚀, and it is now open for free for a limited time with the link below 👇🏼 What does production mean… | Rami...
My recent LinkedIn Learning course, SQL AI Agents in Production, just reached 4,000 learners 🚀, and it is now open for free for a limited time with the link below 👇🏼 What does production mean when wo...
linkedin.com
I'm not sure who gets the credit, but it's brilliant! 😂
A new tutorial in my Docker 🐳 101 series for AI developers — this time focusing on running a container 👇🏼 theaiops.substack.com/p/how-to-run... #docker #ai #mlops
How to Run a Docker Container from an Image
Learn how to run a Docker container from an image, publish a FastAPI port to localhost, verify the API, and stop and remove the container.
theaiops.substack.com
Issue 106 is out! This week’s agenda: 🔹 Open Source of the Week - Posit Commons 🔹 New learning resources 🔹 Book of the week - Learning Generative AI Tools for Excel by Angelica Lo Duca ramikrispin.substack.com/p/posit-comm... #ai #rstats #python #datascience
Posit Commons Data Agents, Generative AI Tools for Excel | Issue 106
Explore Posit Commons, videos on Jev, Bonsai 2, coding agent harnesses, and weather forecasting, plus a book on generative AI tools for Excel.
ramikrispin.substack.com
Started to work on a sequence of tutorials focusing on running LLMs locally on Apple Silicon with MLX LM 👇🏼 github.com/RamiKrispin/... #ai #llm
GitHub - RamiKrispin/local-llms-with-mlx: Running LLMs locally with MLX LM
Running LLMs locally with MLX LM. Contribute to RamiKrispin/local-llms-with-mlx development by creating an account on GitHub.
github.com
Today, I’m proud to announce Homebrew 7.0.0. The most significant changes since 6.0.0 are faster installations, stronger sandboxing, native macOS app, vulnerability checks, advisory database, end of macOS 10.15 support and Intel Macs to Tier 3.
7.0.0
Today, I’m proud to announce Homebrew 7.0.0. The most significant changes since 6.0.0 are faster installations and upgrades, stronger sandboxing, a native macOS app, built-in vulnerability checks and an advisory database, the end of macOS 10.15 support and Intel Macs moving to Tier 3.
brew.sh
A new tutorial in my Docker 🐳 101 series — this time focusing on working with container registries 👇🏼 theaiops.substack.com/p/how-to-pus... #docker #mlops #devops
How to Push a Docker Image to Docker Hub
Learn how to log in to Docker Hub, push a tagged FastAPI image, read the layer and digest output, and verify the published image.
theaiops.substack.com
Issue 104 is out! This week's agenda: 🔹 Open Source of the Week - the TimesFM project from Google 🔹 New learning resources 🔹 Book of the week - Generative AI on Microsoft Azure ramikrispin.substack.com/p/timesfm-ge... #ai #timeseries #forecasting
TimesFM and Generative AI on Microsoft Azure | Issue 105
Explore TimesFM for zero-shot forecasting, six videos on Python, voice dictation, Git, MCP, AI coding workflows, and looped transformers, plus a guide to generative AI on Azure.
ramikrispin.substack.com
After a long break, I am returning to my "Getting Started with SQL AI Agent" series. This sequence of tutorials is going to cover two topics: ✅ Foundation of SQL AI agents ✅ SQL AI agents in production This one covers the prerequisites 👇🏼 ramikrispin.substack.com/p/set-up-a-p...
Set up a Python environment for SQL AI agents
Set up Python for SQL AI agent tutorials with uv, venv and pip, or a Docker-based VS Code Dev Container.
ramikrispin.substack.com
Unsloth released new GLM settings that enable running the model on a 128 Gb RAM machine 3.3x faster using optimized decoding 👇🏼 unsloth.ai/docs/models/...
GLM-5.3-Flash: How to Run Locally | Unsloth Documentation
Run the new GLM-5.3-Flash aka ox-alpha model by Z.ai.
unsloth.ai
Issue 104 is out! This week's agenda: 🔹 Open Source of the Week - the agent-top project by Kannan Kalidasan 🔹 New learning resources 🔹 Book of the week - Designing AI Interfaces: Design Principles for Creative and Autonomous AI by Louise Macfadyen ramikrispin.substack.com/p/agent-top-...
Agent Top, Designing AI Interfaces | Issue 104
A weekly curated update on data science and engineering topics and resources.
ramikrispin.substack.com
A new tutorial in my Docker 🐳 101 series — this time focusing on building Docker images 👇🏼 🔗 theaiops.substack.com/p/how-to-bui... #docker #ai #mlops
How to Build a Docker Image from a Dockerfile
Learn how to build and tag a Docker image from a Dockerfile, understand the build context, read the build output, and confirm the image locally.
theaiops.substack.com
Issue 103 is out! This week's agenda: 🔹 Open Source of the Week - The Archify project 🔹 New learning resources 🔹 Book of the week - Vector Databases: A Practical Introduction by Nitin Borwankar ramikrispin.substack.com/p/the-archif...
The Archify Project, Vector Databases: A Practical Introduction | Issue 103
A weekly curated update on data science and engineering topics and resources.
ramikrispin.substack.com
GLM 5.3 can run locally if you have an appropriate machine with ample RAM (e.g., a 256GB Mac or a system with sufficient RAM/VRAM). Here is a guide from Unsloth: unsloth.ai/docs/models/...
The MLX fast is a new cool community project with the goal of finding the best setting for running different LLM locally on Apple silicon 👇🏼 www.yukon.org/mlxfast
