MLflow
LightNews LightNews
banner
mlflow.org
MLflow
@mlflow.org
81 followers 6 following 200 posts
An open source machine learning platform for managing the complete ML lifecycle
Posts Replies Media Videos
mlflow.org
Two weeks from today — don’t miss it! 🙌

📣 Join the next 𝗠𝗟𝗳𝗹𝗼𝘄 𝗖𝗼𝗺𝗺𝘂𝗻𝗶𝘁𝘆 𝗠𝗲𝗲𝘁𝘂𝗽 on November 12 to explore the latest in AI observability and agent tracing.

Featuring two exciting talks:
🔹 𝗖𝗹𝗮𝘂𝗱𝗲 𝗖𝗼𝗱𝗲 & 𝗔𝗴𝗲𝗻𝘁 𝗦𝗗𝗞 𝗧𝗿𝗮𝗰𝗶𝗻𝗴
🔹 𝗢𝗽𝗲𝗻𝗧𝗲𝗹𝗲𝗺𝗲𝘁𝗿𝘆 (𝗢𝗧𝗘𝗟) 𝗦𝘂𝗽𝗽𝗼𝗿𝘁

🔗 RSVP: luma.com/mlflowmeetup...

#mlflow #oss
MLflow Community Meetup | November 2025 · Luma
November MLflow Community Meetup We'll dive into: 🔹 Claude Code & Claude Agent SDK Tracing Building agentic applications is complex, but it doesn't have to…
luma.com
October 29, 2025 at 3:46 PM
mlflow.org
Building agentic applications is complex, but it doesn’t have to be slow.

In this blog, Samraj Moorjani shows how to go from idea to measurable results in hours using the Claude Agent SDK with MLflow for observability and evaluation.

🔗 Dive in: mlflow.org/blog/mlflow-...

#MLflow #agentic
Rapidly Prototype and Evaluate Agents with Claude Agent SDK and MLflow | MLflow
How to quickly prototype an agent using the Claude Agent SDK then instrument and evaluate it with MLflow
mlflow.org
October 23, 2025 at 11:04 PM
mlflow.org
📣 Join the next 𝗠𝗟𝗳𝗹𝗼𝘄 𝗖𝗼𝗺𝗺𝘂𝗻𝗶𝘁𝘆 𝗠𝗲𝗲𝘁𝘂𝗽 on November 12 to explore the latest in AI observability and agent tracing — featuring two exciting talks:

🔹 𝗖𝗹𝗮𝘂𝗱𝗲 𝗖𝗼𝗱𝗲 & 𝗔𝗴𝗲𝗻𝘁 𝗦𝗗𝗞 𝗧𝗿𝗮𝗰𝗶𝗻𝗴
🔹 𝗢𝗽𝗲𝗻𝗧𝗲𝗹𝗲𝗺𝗲𝘁𝗿𝘆 (𝗢𝗧𝗘𝗟) 𝗦𝘂𝗽𝗽𝗼𝗿𝘁

🔗 RSVP: luma.com/mlflowmeetup...

#MLflow #opensource #oss #genai
MLflow Community Meetup | November 2025 · Luma
November MLflow Community Meetup We'll dive into: 🔹 Claude Code & Claude Agent SDK Tracing Building agentic applications is complex, but it doesn't have to…
luma.com
October 22, 2025 at 6:37 PM
mlflow.org
⏰ Don’t forget — MLflow Office Hours are this Wednesday, October 22 at 8AM PT on Zoom!

Come for:
🔹 Real-time MLflow troubleshooting and guidance
🔹 Best practices for managing LLM & GenAI experiments
🔹 A look ahead at new MLflow features

🔗 RSVP: luma.com/officehours1...

#opensource #oss #MLflow
MLflow Office Hours | October 22 · Zoom · Luma
luma.com
October 20, 2025 at 3:13 PM
mlflow.org
Missed last week’s #MLflow Community Meetup? Check out Ben Wilson on agentic judges: “The judge no longer works as an LLM as a judge—it actually works as an agent as a judge.”

🎥 Full video: www.youtube.com/live/bkMabn8...

#opensource #oss #agenticjudges
October 15, 2025 at 2:14 PM
mlflow.org
Use AI to debug AI! 👏 With MLflow 3.4’s MCP server, Claude can query MLflow traces to compare runs and identify issues. @danliden.com’s post covers setup and examples in minutes.

Learn more: www.danliden.com/posts/202510...

#opensource #mlflow #oss #MCP #claude
Using MLflow's MCP Server for Conversational Trace Analysis
A hands-on exploration of MLflow's new Model Context Protocol server that enables AI assistants to interact with MLflow traces, with setup tips for virtual environments and examples in both Claude ...
www.danliden.com
October 13, 2025 at 4:15 PM
mlflow.org
⚡ In this lightning talk at MLOps World, Danny Chiao tackled a top agent challenge: ensuring high quality output.

Rather than labeling and analyzing traces by hand, MLflow makes it easy to log, evaluate, and iterate faster—using techniques leading companies rely on to deploy agents in production. ✅
October 9, 2025 at 7:31 PM
mlflow.org
🚨 Reminder: MLflow Community Meetup is tomorrow, Oct 8 at 4:00 PM PT!

We'll explore trace‑aware, feedback‑aligned judges and versioned eval datasets in MLflow. You don't wait to miss it!

🎥 LIVE on LinkedIn, YouTube & X
🔗 RSVP: luma.com/mlflow-1001

#opensource #oss #mlflow
October 7, 2025 at 4:42 PM
mlflow.org
Building better LLM evals? Ben Wilson highlights how frameworks like #DSPy boost judge prompts—and reliability—as models evolve.

Tips for judge reproducibility/reliability: use reproducible pipelines, re-tune logic as endpoints change, & standardize. ✅

🎥 Watch more: www.youtube.com/live/HTxpmnO...
October 6, 2025 at 5:59 PM
mlflow.org
Ready to dive into #MLflow? 🚀

Join our text-based LIVE AMA with Danny Chiao & @danliden.com after Danny's MLOps World | GenAI Summit lightning talk!

🗓️ Oct 9 | 1–3pm CT
📍MLflow Slack | #General channel
🔗 RSVP: luma.com/liveama-slac...

#opensource #oss #genai #mlops #llmops
[Live AMA] From production tricks, labeling tips, to integrating MLflow for agent quality—ask anything MLflow! · Luma
Join us for a text-based Live AMA (Ask Me Anything) with Danny Chiao, following his lightning talk at MLOps World. This is your chance to dive deeper into…
luma.com
October 3, 2025 at 6:06 PM
mlflow.org
🚀 Headed to MLOps World | GenAI Summit 2025 next week? Don’t miss an exciting lightning talk from Danny Chiao, Engineering Lead at Databricks!

🎤 𝗧𝗲𝗰𝗵𝗻𝗶𝗾𝘂𝗲𝘀 𝘁𝗼 𝗯𝘂𝗶𝗹𝗱 𝗵𝗶𝗴𝗵 𝗾𝘂𝗮𝗹𝗶𝘁𝘆 𝗮𝗴𝗲𝗻𝘁𝘀 𝗳𝗮𝘀𝘁𝗲𝗿 𝘄𝗶𝘁𝗵 𝗠𝗟𝗳𝗹𝗼𝘄

🗓️ October 9
📍 Austin, TX
🔗 Learn more: mlopsworld.com#agenda

#MLflow #GenAI #MLOps #LLM
October 1, 2025 at 9:17 PM
mlflow.org
🚨 RESCHEDULED: Wednesday, October 8

The next MLflow Community Meetup happens NEXT Wednesday, Oct 8 at 4PM PT—and you won’t want to miss it.

RSVP here: luma.com/mlflow-1001

#opensource #oss #mlflow
October 1, 2025 at 8:23 PM
mlflow.org
Our next MLflow Community Meetup is happening TODAY—Wednesday, October 1 at 4PM PT! 🙌

Don’t miss this chance to connect and learn:
🔹 Smarter Evaluations with Trace-Aware, Feedback-Aligned Judges
🔹 Keeping Eval Datasets Relevant as Your App Evolves

✅ RSVP: luma.com/mlflow-1001

#oss #mlflow #genai
MLflow Community Meetup · Luma
Join us for the next MLflow Community Meetup on October 1 at 4PM PT! Ben Wilson, MLflow Maintainer, will dive deep into: Building Smarter Evals with…
luma.com
October 1, 2025 at 5:52 PM
mlflow.org
🚀 The fifth “Invoice Extraction with OpenAI + MLflow” session is now available! #MLflow Ambassador Shrinath Suresh dives into designing a custom scorer to evaluate invoice extraction models beyond just labels or LLM-as-a-judge.

🎥 youtu.be/SmuhOmOYXSg?...
📖 medium.com/@shrinath.su...

#opensource
September 30, 2025 at 8:05 PM
mlflow.org
🚨 Just 2 days away!

The next #MLflow Community Meetup happens this Wednesday, Oct 1 at 4PM PT—and you won’t want to miss it.

We will cover:
🔹 𝗕𝘂𝗶𝗹𝗱𝗶𝗻𝗴 𝗦𝗺𝗮𝗿𝘁𝗲𝗿 𝗘𝘃𝗮𝗹𝘀 𝘄𝗶𝘁𝗵 𝗧𝗿𝗮𝗰𝗲-𝗔𝘄𝗮𝗿𝗲, 𝗙𝗲𝗲𝗱𝗯𝗮𝗰𝗸-𝗔𝗹𝗶𝗴𝗻𝗲𝗱 𝗝𝘂𝗱𝗴𝗲𝘀
🔹 𝗞𝗲𝗲𝗽𝗶𝗻𝗴 𝗘𝘃𝗮𝗹 𝗗𝗮𝘁𝗮𝘀𝗲𝘁𝘀 𝗥𝗲𝗹𝗲𝘃𝗮𝗻𝘁 𝗮𝘀 𝗬𝗼𝘂𝗿 𝗔𝗽𝗽 𝗖𝗵𝗮𝗻𝗴𝗲𝘀

RSVP 👉 luma.com/mlflow-1001

#oss
MLflow Community Meetup · Luma
Join us for the next MLflow Community Meetup on October 1 at 4PM PT! Ben Wilson, MLflow Maintainer, will dive deep into: Building Smarter Evals with…
luma.com
September 29, 2025 at 2:11 PM
mlflow.org
Episode 3 of Invoice Extraction is live! 🚀

#MLflow Ambassador Shrinath Suresh explores prompt versioning, comparing, automating workflows, and effective reuse with MLflow’s Prompt Registry.

🎥 Watch: youtube.com/watch?v=fau8...
📖 Read: medium.com/@shrinath.su...

#opensource #oss #genai
#3 Prompt Engineering & MLflow Prompt Management
YouTube video by TheAIGuy
youtube.com
September 23, 2025 at 3:27 PM
mlflow.org
Businesses run on invoices. Getting structured data from them—fast and accurate—is critical.

🧩 GPT-5 is powerful for extraction
⚙️ MLflow 3 makes it repeatable & traceable

Demo + blog from #MLflow Ambassador Shrinath Suresh! 👇

▶️ youtu.be/E5GSWLhI5uA
📝 medium.com/@shrinath.su...

#opensource #oss
Introduction to invoice extraction using OpenAI GPT5 and MLflow 3.3
YouTube video by TheAIGuy
youtu.be
September 18, 2025 at 3:09 PM
mlflow.org
🚀 Join the next MLflow Community Meetup on Oct 1 at 4PM PT!

🔹 𝗕𝘂𝗶𝗹𝗱𝗶𝗻𝗴 𝗦𝗺𝗮𝗿𝘁𝗲𝗿 𝗘𝘃𝗮𝗹𝘀 𝘄𝗶𝘁𝗵 𝗧𝗿𝗮𝗰𝗲-𝗔𝘄𝗮𝗿𝗲, 𝗙𝗲𝗲𝗱𝗯𝗮𝗰𝗸-𝗔𝗹𝗶𝗴𝗻𝗲𝗱 𝗝𝘂𝗱𝗴𝗲𝘀
🔹 𝗞𝗲𝗲𝗽𝗶𝗻𝗴 𝗘𝘃𝗮𝗹 𝗗𝗮𝘁𝗮𝘀𝗲𝘁𝘀 𝗥𝗲𝗹𝗲𝘃𝗮𝗻𝘁 𝗮𝘀 𝗬𝗼𝘂𝗿 𝗔𝗽𝗽 𝗖𝗵𝗮𝗻𝗴𝗲𝘀

Bring your questions about dataset management, evaluation workflows! ✅

RSVP 👉 luma.com/mlflow-1001

#opensource #oss
MLflow Community Meetup · Luma
Join us for the next MLflow Community Meetup on October 1 at 4PM PT! Ben Wilson, MLflow Maintainer, will dive deep into: Building Smarter Evals with…
luma.com
September 17, 2025 at 4:50 PM
mlflow.org
This blog highlights how MLflow’s #GenAI capabilities streamline development of an LLM-based Optical Character Recognition (OCR) tool. These capabilities reduce friction, accelerate workflows, and deliver value to both technical and non-technical contributors.

🚀 Dive in: mlflow.org/blog/mlflow-...
September 15, 2025 at 8:05 PM
mlflow.org
This blog looks at the “Coffee Machine” approach: global teams set up standardized #ML pipelines, & local teams adapt them using their own #data. ☕

#MLflow supports every step, making it possible to track changes, register model variants, & maintain reproducibility.

🔗 medium.com/dscier/brewi...
September 11, 2025 at 3:35 PM
mlflow.org
📣 Happening Tomorrow — MLflow Office Hours!

Join #MLflow maintainers for a live Q&A session! Whether you’re running MLflow in production or experimenting with LLMs & GenAI, this is your chance to bring real challenges and get direct feedback.

🕒 Sept 10 @ 3PM SGT
🎟 RSVP: lu.ma/mlflow-910

#oss
September 9, 2025 at 8:34 PM
mlflow.org
Evaluating AI agents is tricky—they make multi-step decisions, use tools, and follow reasoning chains. To measure them, you need to assess the workflow, not just the final answer. That’s where MLflow’s new agent evaluation framework steps in.

🔗 Docs: mlflow.org/docs/latest/...

#MLflow #AI #MLOps
September 5, 2025 at 3:05 PM
mlflow.org
In this blog by #MLflow Ambassador Rahul Pandey, learn how the MLflow Prompt Registry helps teams move from scattered notebook files and chat threads to a streamlined prompt management process—one that’s versioned, searchable, and always ready for rollbacks. 🚀

🔗 Dive in: medium.com/dscier/end-t...
End-to-End Prompt Lifecycle Management and Optimization with MLflow
A complete journey from prompt creation to production deployment using semantic evaluation
medium.com
August 25, 2025 at 11:15 AM
mlflow.org
📣 MLflow 3.3.0 is now available!

This release introduces several major features and improvements:
🔹 𝗠𝗼𝗱𝗲𝗹 𝗥𝗲𝗴𝗶𝘀𝘁𝗿𝘆 𝗪𝗲𝗯𝗵𝗼𝗼𝗸𝘀
🔹 𝗔𝗴𝗻𝗼 𝗧𝗿𝗮𝗰𝗶𝗻𝗴 𝗜𝗻𝘁𝗲𝗴𝗿𝗮𝘁𝗶𝗼𝗻
🔹 𝗚𝗲𝗻𝗔𝗜 𝗘𝘃𝗮𝗹𝘂𝗮𝘁𝗶𝗼𝗻 𝗶𝗻 𝗢𝗦𝗦
🔹 𝗥𝗲𝘃𝗮𝗺𝗽𝗲𝗱 𝗧𝗿𝗮𝗰𝗲 𝗧𝗮𝗯𝗹𝗲 𝗩𝗶𝗲𝘄
🔹 𝗙𝗮𝘀𝘁𝗔𝗣𝗜 + 𝗨𝘃𝗶𝗰𝗼𝗿𝗻 𝗦𝗲𝗿𝘃𝗲𝗿

🔗 Check out the release notes: github.com/mlflow/mlflo...

#oss
August 22, 2025 at 1:17 PM
mlflow.org
📣 MLflow Office Hours — Wednesday, Sept 10

Connect directly with #MLflow maintainers and contributors for live Q&A! Bring your production challenges or your latest #LLM and #GenAI experiments—this session is dedicated to hands-on technical discussion and feedback.

Save your spot ➡️ lu.ma/mlflow-910
MLflow Office Hours | September 10 · Zoom · Luma
Join us for the next MLflow Office Hours on Wednesday, September 10, for an open Q&A session with MLflow maintainers and contributors! 🎊 Whether you're…
lu.ma
August 21, 2025 at 12:23 PM