Yuan Tang
banner
terrytangyuan.xyz
Yuan Tang
@terrytangyuan.xyz
Senior Principal Software Engineer at Red Hat AI | Open Source Leader at KServe, Argo, Kubeflow, Kubernetes, CNCF | Maintainer of XGBoost, TensorFlow | Keynote Speaker | Author | Technical Advisor

More info: http://terrytangyuan.xyz

We are hiring!
Pinned
Super excited to announce that my book Distributed Machine Learning Patterns from Manning Publications is now available in both Chinese and Korean by leading publishers Tsinghua University Press and Hanbit Media!
Finally got my KubeCon professional headshot refreshed! 📸

I’ve been using the one I took three years ago at #KubeCon. It was definitely time for an update.
November 22, 2025 at 3:52 AM
🎤 𝗠𝗼𝗿𝗲 𝘀𝗹𝗶𝗱𝗲𝘀 𝗮𝗿𝗲 𝗮𝘃𝗮𝗶𝗹𝗮𝗯𝗹𝗲!

At #KubeCon North America 2025 in Atlanta, I had the pleasure of joining Stephen Rust, Rajas Kakodkar, and Alex Scammon for our session: 𝘐𝘯𝘵𝘳𝘰𝘥𝘶𝘤𝘪𝘯𝘨 𝘛𝘈𝘎 𝘞𝘰𝘳𝘬𝘭𝘰𝘢𝘥𝘴 𝘍𝘰𝘶𝘯𝘥𝘢𝘵𝘪𝘰𝘯: 𝘈𝘥𝘷𝘢𝘯𝘤𝘪𝘯𝘨 𝘵𝘩𝘦 𝘊𝘰𝘳𝘦
November 21, 2025 at 2:08 AM
Many of us from 𝗥𝗲𝗱 𝗛𝗮𝘁 𝗔𝗜 attended #KubeCon North America in Atlanta last week. We’d like to share some highlights from the Red Hat AI model serving perspective, including llm-d, KServe, vLLM, and @kubernetes.io.

inferenceops.substack.com/p/kubecon-no...
KubeCon North America 2025: Red Hat AI Model Serving Highlights
Most recent updates from several AI/ML model inference communities that our teams at Red Hat AI are contributing to.
inferenceops.substack.com
November 19, 2025 at 3:06 PM
🎤 𝗦𝗹𝗶𝗱𝗲𝘀 𝗻𝗼𝘄 𝗮𝘃𝗮𝗶𝗹𝗮𝗯𝗹𝗲!

At #KubeCon North America 2025 in Atlanta, I had the pleasure of joining @ritazh.bsky.social, Jiaxin Shan, and Sergey Kanzhelev for our session: 𝘕𝘢𝘷𝘪𝘨𝘢𝘵𝘪𝘯𝘨 𝘵𝘩𝘦 𝘙𝘢𝘱𝘪𝘥 𝘌𝘷𝘰𝘭𝘶𝘵𝘪𝘰𝘯 𝘰𝘧 𝘓𝘢𝘳𝘨𝘦 𝘔𝘰𝘥𝘦𝘭 𝘐𝘯𝘧𝘦𝘳𝘦𝘯𝘤𝘦: 𝘞𝘩𝘦𝘳𝘦 𝘋𝘰𝘦𝘴 𝘒𝘶𝘣𝘦𝘳𝘯𝘦𝘵𝘦𝘴 𝘍𝘪𝘵?
November 18, 2025 at 2:44 AM
Back from #KubeCon + #CloudNativeCon North America 2025 in Atlanta! This has been the most fruitful KubeCon of my career.

It was an honor to return to the KubeCon keynote stage in front of more than 9,000 attendees! This time, Anjali Telang and I explored trust and identity in the AI era.
November 16, 2025 at 3:22 AM
Reposted by Yuan Tang
#KubeCon 2025
Anchoring Trust in the Age of AI: Identities Across Humans, Machines, and Models - Yuan Tang and Anjali Telang

KServe is a CNCF incubator project

kserve.github.io/website/

#SPIFFE #SPIRE #Keycloak
November 11, 2025 at 4:17 PM
Reposted by Yuan Tang
Kubernetes AI conformance on the #KubeCon keynote stage! @ritazh.bsky.social, Janet Kuo, Mario Fahlandt, & Yuan Tang github.com/cncf/k8s-ai-...
November 11, 2025 at 2:38 PM
Reposted by Yuan Tang
#KubeCon day 1 keynotes: @terrytangyuan.xyz and Anjali Telang talking about anchoring trust among people, machines, and models. Announced KServe is an incubating project in the CNCF
November 11, 2025 at 3:46 PM
Just arrived in Atlanta for #KubeCon + #CloudNativeCon North America 2025!

If you see me around the hallway or at the sessions, feel free to say hi. I’d love to chat about:
- Model inference (KServe, vLLM, llm-d)
- @kubernetes.io AI Conformance Program
November 10, 2025 at 3:51 AM
🚀 𝗞𝗦𝗲𝗿𝘃𝗲 𝘃𝟬.𝟭𝟲 𝗶𝘀 𝗼𝘂𝘁!

This release introduces 𝗟𝗟𝗠𝗜𝗻𝗳𝗲𝗿𝗲𝗻𝗰𝗲𝗦𝗲𝗿𝘃𝗶𝗰𝗲, a new CRD that integrates with llm-d and brings scalable, production-grade LLM serving on Kubernetes.
November 6, 2025 at 4:57 PM
📢 𝗧𝗵𝗲 𝗦𝘁𝗮𝘁𝗲 𝗼𝗳 𝗠𝗼𝗱𝗲𝗹 𝗦𝗲𝗿𝘃𝗶𝗻𝗴 𝗖𝗼𝗺𝗺𝘂𝗻𝗶𝘁𝗶𝗲𝘀: 𝗡𝗼𝘃𝗲𝗺𝗯𝗲𝗿 𝗘𝗱𝗶𝘁𝗶𝗼𝗻 𝗶𝘀 𝗼𝘂𝘁!

We recently launched our newsletter publicly after sharing it internally at Red Hat AI for over a year.
November 5, 2025 at 7:25 PM
🚀 𝗖𝗙𝗣 𝗗𝗲𝗮𝗱𝗹𝗶𝗻𝗲 𝗖𝗼𝗺𝗶𝗻𝗴 𝗨𝗽 𝗦𝗼𝗼𝗻!

The Call for Proposals for two exciting AI-focused co-located events at KubeCon Europe is closing this 𝗦𝘂𝗻𝗱𝗮𝘆, 𝗡𝗼𝘃 𝟮𝗻𝗱!

𝗔𝗴𝗲𝗻𝘁𝗶𝗰𝘀 𝗗𝗮𝘆: events.linuxfoundation.org/kubecon-clou...
𝗖𝗹𝗼𝘂𝗱 𝗡𝗮𝘁𝗶𝘃𝗲 𝗔𝗜 𝗗𝗮𝘆: events.linuxfoundation.org/kubecon-clou...
October 31, 2025 at 12:34 AM
📚✨ 𝗕𝗼𝗼𝗸 𝗦𝗶𝗴𝗻𝗶𝗻𝗴 𝗮𝗻𝗱 𝗘-𝗕𝗼𝗼𝗸 𝗚𝗶𝘃𝗲𝗮𝘄𝗮𝘆 𝗮𝘁 𝗞𝘂𝗯𝗲𝗖𝗼𝗻 𝗡𝗼𝗿𝘁𝗵 𝗔𝗺𝗲𝗿𝗶𝗰𝗮! ✨📚

If you’re attending #KubeCon in Atlanta and have a copy of my book 𝘋𝘪𝘴𝘵𝘳𝘪𝘣𝘶𝘵𝘦𝘥 𝘔𝘢𝘤𝘩𝘪𝘯𝘦 𝘓𝘦𝘢𝘳𝘯𝘪𝘯𝘨 𝘗𝘢𝘵𝘵𝘦𝘳𝘯𝘴, bring it along and I’d love to sign it! 🖊️

And if you’d like your own copy, use code 𝗞𝘂𝗯𝗲𝗖𝗼𝗻𝟮𝟱𝗮𝘂 starting 𝗡𝗼𝘃 𝟵𝘁𝗵 for 45% off.
October 27, 2025 at 3:03 AM
🚀 𝗪𝗲’𝗿𝗲 𝗛𝗶𝗿𝗶𝗻𝗴 𝗦𝗼𝗳𝘁𝘄𝗮𝗿𝗲 𝗘𝗻𝗴𝗶𝗻𝗲𝗲𝗿𝘀!
Our team at 𝗥𝗲𝗱 𝗛𝗮𝘁 𝗔𝗜 is growing, and we’re looking for passionate engineers (at different levels) to help us push the boundaries of 𝗔𝗜 𝗶𝗻𝗳𝗿𝗮𝘀𝘁𝗿𝘂𝗰𝘁𝘂𝗿𝗲 𝗮𝗻𝗱 𝗺𝗼𝗱𝗲𝗹 𝘀𝗲𝗿𝘃𝗶𝗻𝗴.
October 24, 2025 at 2:39 PM
It was a pleasure to contribute to this video to kick off Community Day at IBM TechXchange!

The theme - The Power of Community - truly resonates with me. Open source and tech communities thrive because of the people who collaborate and innovate together.

Watch the video here 👉 youtu.be/Q0E8ZNMk1Ac
October 23, 2025 at 2:16 AM
🎉 𝟭𝟯𝟯𝗞 𝗺𝗲𝗺𝗯𝗲𝗿𝘀 𝗿𝗲𝗮𝗰𝗵𝗲𝗱, 𝟲𝟵𝟰𝗞 𝗶𝗺𝗽𝗿𝗲𝘀𝘀𝗶𝗼𝗻𝘀, 𝗮𝗻𝗱 𝟭𝟲𝗞 𝗳𝗼𝗹𝗹𝗼𝘄𝗲𝗿𝘀 on LinkedIn.

I never thought of reaching these numbers when I first started sharing on this platform. I’m deeply grateful that these posts have resonated with so many of you.
October 17, 2025 at 3:21 AM
Wrapping up another incredible IBM TechXchange!

The Community Day continues to be my favorite part of the event. I had the chance to connect in person with so many great collaborators from the open source community.
October 11, 2025 at 3:21 AM
October 10, 2025 at 1:57 AM
📢 𝗧𝗵𝗲 𝗦𝘁𝗮𝘁𝗲 𝗼𝗳 𝗠𝗼𝗱𝗲𝗹 𝗦𝗲𝗿𝘃𝗶𝗻𝗴 𝗖𝗼𝗺𝗺𝘂𝗻𝗶𝘁𝗶𝗲𝘀: 𝗢𝗰𝘁𝗼𝗯𝗲𝗿 𝗘𝗱𝗶𝘁𝗶𝗼𝗻 𝗶𝘀 𝗼𝘂𝘁!

We recently launched our newsletter publicly after sharing it internally at Red Hat AI for over a year.
October 9, 2025 at 1:28 PM
🎉 𝗞𝗦𝗲𝗿𝘃𝗲 𝗵𝗮𝘀 𝗯𝗲𝗲𝗻 𝗮𝗰𝗰𝗲𝗽𝘁𝗲𝗱 𝗮𝘀 𝗮 𝗖𝗡𝗖𝗙 𝗜𝗻𝗰𝘂𝗯𝗮𝘁𝗶𝗻𝗴 𝗣𝗿𝗼𝗷𝗲𝗰𝘁! 🚀

Just a short time ago, we shared that our application was under public comment.
September 29, 2025 at 8:24 PM
Today I had the pleasure of finally meeting Josh Bottum - the original Kubeflow Community Manager that every @kubefloworg.bsky.social community member should know. 🙌
September 26, 2025 at 7:46 PM
Excited to share that I’ll be delivering a 𝗸𝗲𝘆𝗻𝗼𝘁𝗲 𝗮𝘁 𝗞𝘂𝗯𝗲𝗖𝗼𝗻 𝗡𝗼𝗿𝘁𝗵 𝗔𝗺𝗲𝗿𝗶𝗰𝗮 𝗶𝗻 𝗔𝘁𝗹𝗮𝗻𝘁𝗮 𝘁𝗵𝗶𝘀 𝗡𝗼𝘃𝗲𝗺𝗯𝗲𝗿!

On the first day of the main conference, I’ll be on stage with Anjali Telang for:
September 24, 2025 at 6:05 PM
Over the past months, I’ve been sharing thoughts on 𝗼𝗽𝗲𝗻 𝘀𝗼𝘂𝗿𝗰𝗲, 𝗹𝗲𝗮𝗱𝗲𝗿𝘀𝗵𝗶𝗽, 𝗮𝗻𝗱 𝗰𝗼𝗺𝗺𝘂𝗻𝗶𝘁𝘆 𝗯𝘂𝗶𝗹𝗱𝗶𝗻𝗴. Here’s a quick roundup of the themes so far:
September 21, 2025 at 2:33 AM
📢 The 𝗺𝗼𝗱𝗲𝗹 𝘀𝗲𝗿𝘃𝗶𝗻𝗴 𝘀𝗽𝗮𝗰𝗲 is moving fast: new projects, community events, and major progress are happening every week. It’s tough to keep track of it all!
September 18, 2025 at 2:41 PM