๐๐ ๐ข๐ฏ๐๐ฒ๐ฟ๐๐ฎ๐ฏ๐ถ๐น๐ถ๐๐ ๐ณ๐ผ๐ฟ ๐๐๐ฒ๐ฟ๐ ๐ง๐๐ฝ๐ฒ๐ฆ๐ฐ๐ฟ๐ถ๐ฝ๐ ๐๐๐ ๐ฆ๐๐ฎ๐ฐ๐ธ ๐ MLflow 3.6 brings automatic tracing to JS/TS! Get traces from Vercel AI SDK, LangChain, Mastra, Anthropic, & Gemini in the same UI as your Python services. ๐ Read more: mlflow.org/blog/typescr... #mlflow #opensource #oss #typescript #llm #ai
MLflow
@mlflow.org
The open source developer platform to build AI applications and models with confidence.
The last 6 months of 2025 were a defining era for MLflow! ๐ โ ๐ญ๐ฐ ๐ฅ๐ฒ๐น๐ฒ๐ฎ๐๐ฒ๐: Focused on LLM Agentic observability, evaluation, & scalability โ ๐ก๐ฒ๐ ๐๐ฒ๐ฎ๐๐๐ฟ๐ฒ๐: GenAI evaluation, unified tracing & more โ ๐๐ผ๐บ๐บ๐๐ป๐ถ๐๐ ๐๐ฟ๐ผ๐๐๐ต: 23 Ambassadors across 17 countries Dive in โก๏ธ www.linkedin.com/pulse/celebr...
Celebration of Innovation: A Retrospective on the MLflow Community's Last Six Months of 2025
Authors: Carly Akerly, Daniel Liden & Jules Damji MLflow 3.x and the GenAI Revolution The past six months have marked a transformative era for MLflow, with a total of 14 releases.
linkedin.com
Weโre excited to announce the release of ๐ ๐๐ณ๐น๐ผ๐ ๐ฏ.๐ด! ๐ Whatโs New? โ๏ธ ๐ฃ๐ฟ๐ผ๐บ๐ฝ๐ ๐ ๐ผ๐ฑ๐ฒ๐น ๐๐ผ๐ป๐ณ๐ถ๐ด๐๐ฟ๐ฎ๐๐ถ๐ผ๐ป โณ ๐๐ป-๐ฃ๐ฟ๐ผ๐ด๐ฟ๐ฒ๐๐ ๐ง๐ฟ๐ฎ๐ฐ๐ฒ ๐๐ถ๐๐ฝ๐น๐ฎ๐ โ๏ธ ๐๐ฒ๐ฒ๐ฝ๐๐๐ฎ๐น ๐ฎ๐ป๐ฑ ๐ฅ๐๐๐๐ฆ ๐๐๐ฑ๐ด๐ฒ๐ ๐๐ป๐๐ฒ๐ด๐ฟ๐ฎ๐๐ถ๐ผ๐ป ๐ก๏ธ ๐๐ผ๐ป๐๐ฒ๐ฟ๐๐ฎ๐๐ถ๐ผ๐ป๐ฎ๐น ๐ฆ๐ฎ๐ณ๐ฒ๐๐ ๐ฆ๐ฐ๐ผ๐ฟ๐ฒ๐ฟ โก ๐๐ผ๐ป๐๐ฒ๐ฟ๐๐ฎ๐๐ถ๐ผ๐ป๐ฎ๐น ๐ง๐ผ๐ผ๐น ๐๐ฎ๐น๐น ๐๐ณ๐ณ๐ถ๐ฐ๐ถ๐ฒ๐ป๐ฐ๐ ๐ฆ๐ฐ๐ผ๐ฟ๐ฒ๐ฟ Dive into the release notes: github.com/mlflow/mlflo...
In this video, #MLflow Contributor and Staff Developer Advocate Jules Damji walks through the powerful new features in MLflow 3.7, showcasing how to gain full observability over your GenAI application traces. ๐ ๐ Watch the full video: youtube.com/watch?v=29W0... #GenAI #LLMOps #OpenSource
MLflow 3.7 Release: Key Features & Multi-turn Conversation Evaluation Demo
YouTube video by MLflow
youtube.com
MLflow Ambassador Joana Ferreira just dropped the next chapter in her GenAI series! ๐ ๐ "๐๐๐ฎ๐น๐๐ฎ๐๐ถ๐ป๐ด ๐๐ฒ๐ป๐๐ ๐๐ถ๐๐ต ๐ ๐๐ณ๐น๐ผ๐: ๐ ๐ผ๐ป๐ถ๐๐ผ๐ฟ๐ถ๐ป๐ด ๐ถ๐ป ๐ฃ๐ฟ๐ผ๐ฑ๐๐ฐ๐๐ถ๐ผ๐ป" Learn to use MLflowโs unified evaluation framework for continuous production monitoring. Dive in: medium.com/@joana.c.mes... #MLflow #GenAI #OpenSource
Stop the AI Agent "vibe checks" & manual labeling! ๐๐ ๏ธ Samraj Moorjani (Databricks) shows how #MLflow accelerates high-quality, production-ready agent development. Learn the techniques leading companies use to skip the iteration loop. ๐ ๐ฅ Watch the full session: www.youtube.com/watch?v=qOFK...
MLflow 3.7.0 is here and it brings major features and improvements for GenAI Observability, Evaluation, and Prompt Management! ๐๐ฅณ ๐ View the release notes: github.com/mlflow/mlflo... Thanks to all the contributions from the community! ๐ ๐ Try it out: pip install mlflow==3.7.0 #opensource #mlflow
Why log GenAI models as code? It's essential for ensuring versioning & reproducibility of API-based models, providing clear traceability for the model's logic & dependencies. Learn how to log GenAI models as code directly from Python into MLflow Tracking. โคต๏ธ ๐ฅ ๐ช๐ฎ๐๐ฐ๐ต: www.youtube.com/watch?v=jXzH...
Getting Started with Mlflow: Logging GenAI Models as Code
YouTube video by MLflow
youtube.com
Is your GenAI agent production-ready, or just passing "vibe checks"? ๐ค Building is easy. Quality is hard. Samraj Moorjani (Databricks) breaks down the full MLflow Quality stack: ๐ Tracing (@opentelemetry.io) ๐ค AI-based Debugging (AI Insights) โ๏ธ LLM as a Judge ๐ฅDive in: youtube.com/watch?v=J92r...
How to Test GenAI Agents in Production: MLflow Tracing & Evaluation Deep Dive
YouTube video by VectorLab
youtube.com
Only a few days left to apply for the next #MLflow Ambassador cohort! ๐ Join a global group of leaders advancing open source MLflow and helping teams ship high-quality #GenAI with evaluation, tracing, and prompt management. Submit your application by ๐๐ฒ๐ฐ ๐ญ. ๐ Apply today: forms.gle/eBEf6fTfKWNm...
Two weeks from today โ donโt miss it! ๐ ๐ฃ Join the next ๐ ๐๐ณ๐น๐ผ๐ ๐๐ผ๐บ๐บ๐๐ป๐ถ๐๐ ๐ ๐ฒ๐ฒ๐๐๐ฝ on November 12 to explore the latest in AI observability and agent tracing. Featuring two exciting talks: ๐น ๐๐น๐ฎ๐๐ฑ๐ฒ ๐๐ผ๐ฑ๐ฒ & ๐๐ด๐ฒ๐ป๐ ๐ฆ๐๐ ๐ง๐ฟ๐ฎ๐ฐ๐ถ๐ป๐ด ๐น ๐ข๐ฝ๐ฒ๐ป๐ง๐ฒ๐น๐ฒ๐บ๐ฒ๐๐ฟ๐ (๐ข๐ง๐๐) ๐ฆ๐๐ฝ๐ฝ๐ผ๐ฟ๐ ๐ RSVP: luma.com/mlflowmeetup... #mlflow #oss
MLflow Community Meetup | November 2025 ยท Luma
November MLflow Community Meetup We'll dive into: ๐น Claude Code & Claude Agent SDK Tracing Building agentic applications is complex, but it doesn't have toโฆ
luma.com
Building agentic applications is complex, but it doesnโt have to be slow. In this blog, Samraj Moorjani shows how to go from idea to measurable results in hours using the Claude Agent SDK with MLflow for observability and evaluation. ๐ Dive in: mlflow.org/blog/mlflow-... #MLflow #agentic
Rapidly Prototype and Evaluate Agents with Claude Agent SDK and MLflow | MLflow
How to quickly prototype an agent using the Claude Agent SDK then instrument and evaluate it with MLflow
mlflow.org
๐ฃ Join the next ๐ ๐๐ณ๐น๐ผ๐ ๐๐ผ๐บ๐บ๐๐ป๐ถ๐๐ ๐ ๐ฒ๐ฒ๐๐๐ฝ on November 12 to explore the latest in AI observability and agent tracing โ featuring two exciting talks: ๐น ๐๐น๐ฎ๐๐ฑ๐ฒ ๐๐ผ๐ฑ๐ฒ & ๐๐ด๐ฒ๐ป๐ ๐ฆ๐๐ ๐ง๐ฟ๐ฎ๐ฐ๐ถ๐ป๐ด ๐น ๐ข๐ฝ๐ฒ๐ป๐ง๐ฒ๐น๐ฒ๐บ๐ฒ๐๐ฟ๐ (๐ข๐ง๐๐) ๐ฆ๐๐ฝ๐ฝ๐ผ๐ฟ๐ ๐ RSVP: luma.com/mlflowmeetup... #MLflow #opensource #oss #genai
MLflow Community Meetup | November 2025 ยท Luma
November MLflow Community Meetup We'll dive into: ๐น Claude Code & Claude Agent SDK Tracing Building agentic applications is complex, but it doesn't have toโฆ
luma.com
โฐ Donโt forget โ MLflow Office Hours are this Wednesday, October 22 at 8AM PT on Zoom! Come for: ๐น Real-time MLflow troubleshooting and guidance ๐น Best practices for managing LLM & GenAI experiments ๐น A look ahead at new MLflow features ๐ RSVP: luma.com/officehours1... #opensource #oss #MLflow
MLflow Office Hours | October 22 ยท Zoom ยท Luma
luma.com
Missed last weekโs #MLflow Community Meetup? Check out Ben Wilson on agentic judges: โThe judge no longer works as an LLM as a judgeโit actually works as an agent as a judge.โ ๐ฅ Full video: www.youtube.com/live/bkMabn8... #opensource #oss #agenticjudges
Use AI to debug AI! ๐ With MLflow 3.4โs MCP server, Claude can query MLflow traces to compare runs and identify issues. @danliden.comโs post covers setup and examples in minutes. Learn more: www.danliden.com/posts/202510... #opensource #mlflow #oss #MCP #claude
Using MLflow's MCP Server for Conversational Trace Analysis
A hands-on exploration of MLflow's new Model Context Protocol server that enables AI assistants to interact with MLflow traces, with setup tips for virtual environments and examples in both Claude ...
danliden.com
โก In this lightning talk at MLOps World, Danny Chiao tackled a top agent challenge: ensuring high quality output. Rather than labeling and analyzing traces by hand, MLflow makes it easy to log, evaluate, and iterate fasterโusing techniques leading companies rely on to deploy agents in production. โ
๐จ Reminder: MLflow Community Meetup is tomorrow, Oct 8 at 4:00 PM PT! We'll explore traceโaware, feedbackโaligned judges and versioned eval datasets in MLflow. You don't wait to miss it! ๐ฅ LIVE on LinkedIn, YouTube & X ๐ RSVP: luma.com/mlflow-1001 #opensource #oss #mlflow
Building better LLM evals? Ben Wilson highlights how frameworks like #DSPy boost judge promptsโand reliabilityโas models evolve. Tips for judge reproducibility/reliability: use reproducible pipelines, re-tune logic as endpoints change, & standardize. โ ๐ฅ Watch more: www.youtube.com/live/HTxpmnO...
Ready to dive into #MLflow? ๐ Join our text-based LIVE AMA with Danny Chiao & @danliden.com after Danny's MLOps World | GenAI Summit lightning talk! ๐๏ธ Oct 9 | 1โ3pm CT ๐MLflow Slack | #General channel ๐ RSVP: luma.com/liveama-slac... #opensource #oss #genai #mlops #llmops
[Live AMA] From production tricks, labeling tips, to integrating MLflow for agent qualityโask anything MLflow! ยท Luma
Join us for a text-based Live AMA (Ask Me Anything) with Danny Chiao, following his lightning talk at MLOps World. This is your chance to dive deeper intoโฆ
luma.com
๐ Headed to MLOps World | GenAI Summit 2025 next week? Donโt miss an exciting lightning talk from Danny Chiao, Engineering Lead at Databricks! ๐ค ๐ง๐ฒ๐ฐ๐ต๐ป๐ถ๐พ๐๐ฒ๐ ๐๐ผ ๐ฏ๐๐ถ๐น๐ฑ ๐ต๐ถ๐ด๐ต ๐พ๐๐ฎ๐น๐ถ๐๐ ๐ฎ๐ด๐ฒ๐ป๐๐ ๐ณ๐ฎ๐๐๐ฒ๐ฟ ๐๐ถ๐๐ต ๐ ๐๐ณ๐น๐ผ๐ ๐๏ธ October 9 ๐ Austin, TX ๐ Learn more: mlopsworld.com#agenda #MLflow #GenAI #MLOps #LLM
๐จ RESCHEDULED: Wednesday, October 8 The next MLflow Community Meetup happens NEXT Wednesday, Oct 8 at 4PM PTโand you wonโt want to miss it. RSVP here: luma.com/mlflow-1001 #opensource #oss #mlflow
MLflow Community Meetup ยท Luma
Join us for the next MLflow Community Meetup on October 1 at 4PM PT! Ben Wilson, MLflow Maintainer, will dive deep into: Building Smarter Evals withโฆ
luma.com
Our next MLflow Community Meetup is happening TODAYโWednesday, October 1 at 4PM PT! ๐ Donโt miss this chance to connect and learn: ๐น Smarter Evaluations with Trace-Aware, Feedback-Aligned Judges ๐น Keeping Eval Datasets Relevant as Your App Evolves โ RSVP: luma.com/mlflow-1001 #oss #mlflow #genai
Our next MLflow Community Meetup is happening TODAYโWednesday, October 1 at 4PM PT! ๐ Donโt miss this chance to connect and learn: ๐น Smarter Evaluations with Trace-Aware, Feedback-Aligned Judges ๐น Keeping Eval Datasets Relevant as Your App Evolves โ RSVP: luma.com/mlflow-1001 #oss #mlflow #genai
MLflow Community Meetup ยท Luma
Join us for the next MLflow Community Meetup on October 1 at 4PM PT! Ben Wilson, MLflow Maintainer, will dive deep into: Building Smarter Evals withโฆ
luma.com
๐ The fifth โInvoice Extraction with OpenAI + MLflowโ session is now available! #MLflow Ambassador Shrinath Suresh dives into designing a custom scorer to evaluate invoice extraction models beyond just labels or LLM-as-a-judge. ๐ฅ youtu.be/SmuhOmOYXSg?... ๐ medium.com/@shrinath.su... #opensource
๐จ Just 2 days away! The next #MLflow Community Meetup happens this Wednesday, Oct 1 at 4PM PTโand you wonโt want to miss it. We will cover: ๐น ๐๐๐ถ๐น๐ฑ๐ถ๐ป๐ด ๐ฆ๐บ๐ฎ๐ฟ๐๐ฒ๐ฟ ๐๐๐ฎ๐น๐ ๐๐ถ๐๐ต ๐ง๐ฟ๐ฎ๐ฐ๐ฒ-๐๐๐ฎ๐ฟ๐ฒ, ๐๐ฒ๐ฒ๐ฑ๐ฏ๐ฎ๐ฐ๐ธ-๐๐น๐ถ๐ด๐ป๐ฒ๐ฑ ๐๐๐ฑ๐ด๐ฒ๐ ๐น ๐๐ฒ๐ฒ๐ฝ๐ถ๐ป๐ด ๐๐๐ฎ๐น ๐๐ฎ๐๐ฎ๐๐ฒ๐๐ ๐ฅ๐ฒ๐น๐ฒ๐๐ฎ๐ป๐ ๐ฎ๐ ๐ฌ๐ผ๐๐ฟ ๐๐ฝ๐ฝ ๐๐ต๐ฎ๐ป๐ด๐ฒ๐ RSVP ๐ luma.com/mlflow-1001 #oss
MLflow Community Meetup ยท Luma
Join us for the next MLflow Community Meetup on October 1 at 4PM PT! Ben Wilson, MLflow Maintainer, will dive deep into: Building Smarter Evals withโฆ
luma.com
Episode 3 of Invoice Extraction is live! ๐ #MLflow Ambassador Shrinath Suresh explores prompt versioning, comparing, automating workflows, and effective reuse with MLflowโs Prompt Registry. ๐ฅ Watch: youtube.com/watch?v=fau8... ๐ Read: medium.com/@shrinath.su... #opensource #oss #genai
#3 Prompt Engineering & MLflow Prompt Management
YouTube video by TheAIGuy
youtube.com
Businesses run on invoices. Getting structured data from themโfast and accurateโis critical. ๐งฉ GPT-5 is powerful for extraction โ๏ธ MLflow 3 makes it repeatable & traceable Demo + blog from #MLflow Ambassador Shrinath Suresh! ๐ โถ๏ธ youtu.be/E5GSWLhI5uA ๐ medium.com/@shrinath.su... #opensource #oss
Introduction to invoice extraction using OpenAI GPT5 and MLflow 3.3
YouTube video by TheAIGuy
youtu.be
๐ Join the next MLflow Community Meetup on Oct 1 at 4PM PT! ๐น ๐๐๐ถ๐น๐ฑ๐ถ๐ป๐ด ๐ฆ๐บ๐ฎ๐ฟ๐๐ฒ๐ฟ ๐๐๐ฎ๐น๐ ๐๐ถ๐๐ต ๐ง๐ฟ๐ฎ๐ฐ๐ฒ-๐๐๐ฎ๐ฟ๐ฒ, ๐๐ฒ๐ฒ๐ฑ๐ฏ๐ฎ๐ฐ๐ธ-๐๐น๐ถ๐ด๐ป๐ฒ๐ฑ ๐๐๐ฑ๐ด๐ฒ๐ ๐น ๐๐ฒ๐ฒ๐ฝ๐ถ๐ป๐ด ๐๐๐ฎ๐น ๐๐ฎ๐๐ฎ๐๐ฒ๐๐ ๐ฅ๐ฒ๐น๐ฒ๐๐ฎ๐ป๐ ๐ฎ๐ ๐ฌ๐ผ๐๐ฟ ๐๐ฝ๐ฝ ๐๐ต๐ฎ๐ป๐ด๐ฒ๐ Bring your questions about dataset management, evaluation workflows! โ RSVP ๐ luma.com/mlflow-1001 #opensource #oss
MLflow Community Meetup ยท Luma
Join us for the next MLflow Community Meetup on October 1 at 4PM PT! Ben Wilson, MLflow Maintainer, will dive deep into: Building Smarter Evals withโฆ
luma.com
This blog highlights how MLflowโs #GenAI capabilities streamline development of an LLM-based Optical Character Recognition (OCR) tool. These capabilities reduce friction, accelerate workflows, and deliver value to both technical and non-technical contributors. ๐ Dive in: mlflow.org/blog/mlflow-...
This blog looks at the โCoffee Machineโ approach: global teams set up standardized #ML pipelines, & local teams adapt them using their own #data. โ #MLflow supports every step, making it possible to track changes, register model variants, & maintain reproducibility. ๐ medium.com/dscier/brewi...