Mikyo
@mikeldking.bsky.social
Building the future of OSS AI observability ☕️🚲🧗🏻♂️🏂⛰🕴
Tracing and telemetry traditionally has been an operational requirement, not a development one. But I've found that with AI applications this fundamentally changes.
July 12, 2025 at 5:55 PM
Tracing and telemetry traditionally has been an operational requirement, not a development one. But I've found that with AI applications this fundamentally changes.
🐳
@arize.bsky.social OSS Prompt Playground
@arize-phoenix.bsky.social gets Deepseek support! Now you can compare outputs of all the top tier reasoning models.
Which LLM provider would you like to see next? Let us know on GitHub!
github.com/Arize-ai/pho...
@arize.bsky.social OSS Prompt Playground
@arize-phoenix.bsky.social gets Deepseek support! Now you can compare outputs of all the top tier reasoning models.
Which LLM provider would you like to see next? Let us know on GitHub!
github.com/Arize-ai/pho...
May 29, 2025 at 3:09 PM
🐳
@arize.bsky.social OSS Prompt Playground
@arize-phoenix.bsky.social gets Deepseek support! Now you can compare outputs of all the top tier reasoning models.
Which LLM provider would you like to see next? Let us know on GitHub!
github.com/Arize-ai/pho...
@arize.bsky.social OSS Prompt Playground
@arize-phoenix.bsky.social gets Deepseek support! Now you can compare outputs of all the top tier reasoning models.
Which LLM provider would you like to see next? Let us know on GitHub!
github.com/Arize-ai/pho...
👨🍳 @arize-phoenix.bsky.social continues to cook
Announcing OpenInference instrumentation for Agno, Mastra, Bedrock Agents, and AutoGen AgentChat!
At @arize.bsky.social we believe observability deserves to be built in the open
s/o @anthonypowell.me and many others
github.com/Arize-ai/ope...
Announcing OpenInference instrumentation for Agno, Mastra, Bedrock Agents, and AutoGen AgentChat!
At @arize.bsky.social we believe observability deserves to be built in the open
s/o @anthonypowell.me and many others
github.com/Arize-ai/ope...
May 23, 2025 at 4:14 AM
👨🍳 @arize-phoenix.bsky.social continues to cook
Announcing OpenInference instrumentation for Agno, Mastra, Bedrock Agents, and AutoGen AgentChat!
At @arize.bsky.social we believe observability deserves to be built in the open
s/o @anthonypowell.me and many others
github.com/Arize-ai/ope...
Announcing OpenInference instrumentation for Agno, Mastra, Bedrock Agents, and AutoGen AgentChat!
At @arize.bsky.social we believe observability deserves to be built in the open
s/o @anthonypowell.me and many others
github.com/Arize-ai/ope...
Reposted by Mikyo
🧪 📊 The @arize-phoenix.bsky.social TS/JS client now supports Experiments and Datasets!
You can now create datasets, run experiments, and attach evaluations to experiments using the Phoenix TS/JS client.
Shoutout to @anthonypowell.me and @mikeldking.bsky.social for the work here!
You can now create datasets, run experiments, and attach evaluations to experiments using the Phoenix TS/JS client.
Shoutout to @anthonypowell.me and @mikeldking.bsky.social for the work here!
May 21, 2025 at 2:26 PM
🧪 📊 The @arize-phoenix.bsky.social TS/JS client now supports Experiments and Datasets!
You can now create datasets, run experiments, and attach evaluations to experiments using the Phoenix TS/JS client.
Shoutout to @anthonypowell.me and @mikeldking.bsky.social for the work here!
You can now create datasets, run experiments, and attach evaluations to experiments using the Phoenix TS/JS client.
Shoutout to @anthonypowell.me and @mikeldking.bsky.social for the work here!
@arizeai/phoenix-client@1.3.0 -
@arize-phoenix.bsky.social javascript client gets experiments 🧪
s/o @anthonypowell.me !
- native tracing of ai tasks and evaluators,
- async concurrency queues
- support for any evaluator (e.g. bring your own evals) and more!
@arize-phoenix.bsky.social javascript client gets experiments 🧪
s/o @anthonypowell.me !
- native tracing of ai tasks and evaluators,
- async concurrency queues
- support for any evaluator (e.g. bring your own evals) and more!
May 14, 2025 at 10:47 PM
@arizeai/phoenix-client@1.3.0 -
@arize-phoenix.bsky.social javascript client gets experiments 🧪
s/o @anthonypowell.me !
- native tracing of ai tasks and evaluators,
- async concurrency queues
- support for any evaluator (e.g. bring your own evals) and more!
@arize-phoenix.bsky.social javascript client gets experiments 🧪
s/o @anthonypowell.me !
- native tracing of ai tasks and evaluators,
- async concurrency queues
- support for any evaluator (e.g. bring your own evals) and more!
OpenTelemetry instrumentation for Agno is published! Huge s/o to Dirk Brand.
A true testament that AI observability should be built in the open 👏
@arize-phoenix.bsky.social
pypi.org/project/open...
A true testament that AI observability should be built in the open 👏
@arize-phoenix.bsky.social
pypi.org/project/open...
Client Challenge
pypi.org
May 12, 2025 at 2:23 PM
OpenTelemetry instrumentation for Agno is published! Huge s/o to Dirk Brand.
A true testament that AI observability should be built in the open 👏
@arize-phoenix.bsky.social
pypi.org/project/open...
A true testament that AI observability should be built in the open 👏
@arize-phoenix.bsky.social
pypi.org/project/open...
📝Annotation Configs in @arize-phoenix.bsky.social
Part of the "Look at the Data" initiative, create custom rubrics and forms to annotate your spans.
s/o to @anthonypowell.me here who built out all the rich UI features.
Part of the "Look at the Data" initiative, create custom rubrics and forms to annotate your spans.
s/o to @anthonypowell.me here who built out all the rich UI features.
May 9, 2025 at 6:28 PM
📝Annotation Configs in @arize-phoenix.bsky.social
Part of the "Look at the Data" initiative, create custom rubrics and forms to annotate your spans.
s/o to @anthonypowell.me here who built out all the rich UI features.
Part of the "Look at the Data" initiative, create custom rubrics and forms to annotate your spans.
s/o to @anthonypowell.me here who built out all the rich UI features.
9⃣ @arize-phoenix.bsky.social is gonna turn 9 today.
Project Retention Policies
Customize the data retention of your projects by number of days or by trace count. No more cron jobs or manual deleting of traces needed!
A much requested ask from our on-prem users and phoenix-cloud users alike.
Project Retention Policies
Customize the data retention of your projects by number of days or by trace count. No more cron jobs or manual deleting of traces needed!
A much requested ask from our on-prem users and phoenix-cloud users alike.
May 9, 2025 at 5:39 PM
9⃣ @arize-phoenix.bsky.social is gonna turn 9 today.
Project Retention Policies
Customize the data retention of your projects by number of days or by trace count. No more cron jobs or manual deleting of traces needed!
A much requested ask from our on-prem users and phoenix-cloud users alike.
Project Retention Policies
Customize the data retention of your projects by number of days or by trace count. No more cron jobs or manual deleting of traces needed!
A much requested ask from our on-prem users and phoenix-cloud users alike.
Reposted by Mikyo
Learn to prompt better
May 7, 2025 at 7:26 PM
Learn to prompt better
Reposted by Mikyo
I'll be speaking at Arize:Observe at SHACK15 on June 25! Looking forward to exploring what’s next for AI agents & assistants. More details on my session to come. @arize.bsky.social
arize.com/observe-2025
arize.com/observe-2025
April 14, 2025 at 3:01 PM
I'll be speaking at Arize:Observe at SHACK15 on June 25! Looking forward to exploring what’s next for AI agents & assistants. More details on my session to come. @arize.bsky.social
arize.com/observe-2025
arize.com/observe-2025
I still own plenty of pencils but no erasers. What does that say about me?
April 26, 2025 at 3:56 PM
I still own plenty of pencils but no erasers. What does that say about me?
Reposted by Mikyo
Just dropped a tutorial on using the OpenAI Agents SDK + @arize-phoenix.bsky.social to go from building to evaluating agents.
✔️ Trace agent decisions at every step
✔️ Offline and Online Evals using LLM as a Judge
If you're building agents, measuring them is essential.
Full vid and cookbook below
✔️ Trace agent decisions at every step
✔️ Offline and Online Evals using LLM as a Judge
If you're building agents, measuring them is essential.
Full vid and cookbook below
April 18, 2025 at 6:51 PM
Just dropped a tutorial on using the OpenAI Agents SDK + @arize-phoenix.bsky.social to go from building to evaluating agents.
✔️ Trace agent decisions at every step
✔️ Offline and Online Evals using LLM as a Judge
If you're building agents, measuring them is essential.
Full vid and cookbook below
✔️ Trace agent decisions at every step
✔️ Offline and Online Evals using LLM as a Judge
If you're building agents, measuring them is essential.
Full vid and cookbook below
Reposted by Mikyo
Demo your app at this year's Observe! Fill out a short application by 4.30 to be considered for our Demo Den. Great opportunity to showcase your work to the AI community in SF.
Apply here: docs.google.com/forms/d/e/1F...
Apply here: docs.google.com/forms/d/e/1F...
March 28, 2025 at 9:11 PM
Demo your app at this year's Observe! Fill out a short application by 4.30 to be considered for our Demo Den. Great opportunity to showcase your work to the AI community in SF.
Apply here: docs.google.com/forms/d/e/1F...
Apply here: docs.google.com/forms/d/e/1F...
Reposted by Mikyo
"The purpose of abstraction is not to be vague, but to create a new semantic level in which one can be absolutely precise." - Edsger W. Dijkstra. Just read this and I am going to be using it a LOT.
March 21, 2025 at 6:11 PM
"The purpose of abstraction is not to be vague, but to create a new semantic level in which one can be absolutely precise." - Edsger W. Dijkstra. Just read this and I am going to be using it a LOT.
Reposted by Mikyo
In case you missed it, Arize AI Phoenix crossed the 5k GitHub star mark last week! ⭐️
Phoenix has changed a TON since its first iteration.
I'm constantly in awe of the execution speed and quality of this team. Here's to the next 5k and beyond!
Phoenix has changed a TON since its first iteration.
I'm constantly in awe of the execution speed and quality of this team. Here's to the next 5k and beyond!
March 20, 2025 at 4:07 PM
In case you missed it, Arize AI Phoenix crossed the 5k GitHub star mark last week! ⭐️
Phoenix has changed a TON since its first iteration.
I'm constantly in awe of the execution speed and quality of this team. Here's to the next 5k and beyond!
Phoenix has changed a TON since its first iteration.
I'm constantly in awe of the execution speed and quality of this team. Here's to the next 5k and beyond!
Love the community we're building!
🎉 5000 Stars and Counting... 🎉
We're celebrating Phoenix reaching 5000 stars on GitHub! This milestone underscores the growing demand for robust, open-source tools that tackle the complexities of AI and LLM development
Check it out: github.com/Arize-ai/pho...
www.youtube.com/watch?v=bW5Z...
We're celebrating Phoenix reaching 5000 stars on GitHub! This milestone underscores the growing demand for robust, open-source tools that tackle the complexities of AI and LLM development
Check it out: github.com/Arize-ai/pho...
www.youtube.com/watch?v=bW5Z...
Arize Phoenix – 5,000 Stars on GitHub!
YouTube video by Arize AI
www.youtube.com
March 19, 2025 at 5:49 PM
Love the community we're building!
Reposted by Mikyo
For all my NYC friends! 🗽🍎
We're hosting an in-person office hours tomorrow all around LLM and Agent Evals.
Join for the free snacks/drinks, stay for the heated discussions about the validity of Pokemon-based model evaluations ⚡️🐀
We're hosting an in-person office hours tomorrow all around LLM and Agent Evals.
Join for the free snacks/drinks, stay for the heated discussions about the validity of Pokemon-based model evaluations ⚡️🐀
LLM Evals Office Hours with Arize · Luma
Join us for an open coworking session focused on LLM and Agent Evaluations! Whether you're actively working on evaluation strategies or just exploring the…
lu.ma
March 18, 2025 at 6:20 PM
For all my NYC friends! 🗽🍎
We're hosting an in-person office hours tomorrow all around LLM and Agent Evals.
Join for the free snacks/drinks, stay for the heated discussions about the validity of Pokemon-based model evaluations ⚡️🐀
We're hosting an in-person office hours tomorrow all around LLM and Agent Evals.
Join for the free snacks/drinks, stay for the heated discussions about the validity of Pokemon-based model evaluations ⚡️🐀
Reposted by Mikyo
How much more data does an LLM app really need?
In my latest tutorial, I explore how few-shot prompting boosts accuracy without massive datasets or retraining—using @arize-phoenix.bsky.social prompts and experiments to break it down.
This kicks off my prompting series... more to come!
In my latest tutorial, I explore how few-shot prompting boosts accuracy without massive datasets or retraining—using @arize-phoenix.bsky.social prompts and experiments to break it down.
This kicks off my prompting series... more to come!
March 18, 2025 at 11:50 PM
How much more data does an LLM app really need?
In my latest tutorial, I explore how few-shot prompting boosts accuracy without massive datasets or retraining—using @arize-phoenix.bsky.social prompts and experiments to break it down.
This kicks off my prompting series... more to come!
In my latest tutorial, I explore how few-shot prompting boosts accuracy without massive datasets or retraining—using @arize-phoenix.bsky.social prompts and experiments to break it down.
This kicks off my prompting series... more to come!
🤖 OpenAI 's agent framework openai-agents provides a rich set of composable primitives that enable you to build agents.
openinference-instrumentation-openai-agents, an OpenTelememetry instrumentor that is compatible with any OTel backend like @arize-phoenix.bsky.social. Fully OSS and free to use!
openinference-instrumentation-openai-agents, an OpenTelememetry instrumentor that is compatible with any OTel backend like @arize-phoenix.bsky.social. Fully OSS and free to use!
March 16, 2025 at 2:54 PM
🤖 OpenAI 's agent framework openai-agents provides a rich set of composable primitives that enable you to build agents.
openinference-instrumentation-openai-agents, an OpenTelememetry instrumentor that is compatible with any OTel backend like @arize-phoenix.bsky.social. Fully OSS and free to use!
openinference-instrumentation-openai-agents, an OpenTelememetry instrumentor that is compatible with any OTel backend like @arize-phoenix.bsky.social. Fully OSS and free to use!
Reposted by Mikyo
How can you programmatically improve your prompts? 🤔 🤖
Forget manual prompt engineering - there are better (read: "more automatic") ways to improve your prompts.
This video and notebook break down these techniques.
Featuring:
- DSPy
- @arize-phoenix.bsky.social
Forget manual prompt engineering - there are better (read: "more automatic") ways to improve your prompts.
This video and notebook break down these techniques.
Featuring:
- DSPy
- @arize-phoenix.bsky.social
March 3, 2025 at 5:01 PM
How can you programmatically improve your prompts? 🤔 🤖
Forget manual prompt engineering - there are better (read: "more automatic") ways to improve your prompts.
This video and notebook break down these techniques.
Featuring:
- DSPy
- @arize-phoenix.bsky.social
Forget manual prompt engineering - there are better (read: "more automatic") ways to improve your prompts.
This video and notebook break down these techniques.
Featuring:
- DSPy
- @arize-phoenix.bsky.social
Reposted by Mikyo
Learn how we built a holistic prompt management system that preserves developer freedom.
With Phoenix 8.0, we built a prompt management system that prioritizes: LLM reproducibility, prompt versioning & tracking, & developer flexibility—no vendor lock-in
arize.com/blog/prompt-...
With Phoenix 8.0, we built a prompt management system that prioritizes: LLM reproducibility, prompt versioning & tracking, & developer flexibility—no vendor lock-in
arize.com/blog/prompt-...
Prompt Management from First Principles
In Phoenix 8.0, we built a prompt management system to ensure reproducibility and empower developers with better testing and control.
arize.com
March 7, 2025 at 5:45 PM
Learn how we built a holistic prompt management system that preserves developer freedom.
With Phoenix 8.0, we built a prompt management system that prioritizes: LLM reproducibility, prompt versioning & tracking, & developer flexibility—no vendor lock-in
arize.com/blog/prompt-...
With Phoenix 8.0, we built a prompt management system that prioritizes: LLM reproducibility, prompt versioning & tracking, & developer flexibility—no vendor lock-in
arize.com/blog/prompt-...
AI is all about vibes lately
March 1, 2025 at 4:37 PM
AI is all about vibes lately
Reposted by Mikyo
Reposted by Mikyo
With Phoenix 8.0 you can version & iterate on prompts seamlessly—both in the UI & in code! What's new:
🔗 TypeScript Client: Sync prompts with your JavaScript runtime
🐍 Python Client: Sync templates & apply them directly to AI SDKs
🔄 Native prompt normalization & much more!
youtu.be/qbeohWaRlsM
🔗 TypeScript Client: Sync prompts with your JavaScript runtime
🐍 Python Client: Sync templates & apply them directly to AI SDKs
🔄 Native prompt normalization & much more!
youtu.be/qbeohWaRlsM
Phoenix 8.0 - Prompts
YouTube video by Arize AI
youtu.be
February 28, 2025 at 9:07 PM
With Phoenix 8.0 you can version & iterate on prompts seamlessly—both in the UI & in code! What's new:
🔗 TypeScript Client: Sync prompts with your JavaScript runtime
🐍 Python Client: Sync templates & apply them directly to AI SDKs
🔄 Native prompt normalization & much more!
youtu.be/qbeohWaRlsM
🔗 TypeScript Client: Sync prompts with your JavaScript runtime
🐍 Python Client: Sync templates & apply them directly to AI SDKs
🔄 Native prompt normalization & much more!
youtu.be/qbeohWaRlsM
Reposted by Mikyo
🤖 Building agents, but not sure how to measure their performance?
Our newest blog post on @hf.co has you covered!
This post shows you how to use @arize-phoenix.bsky.social to trace and evaluate your smolagents.
Credit to @srichavali.bsky.social and @aymeric-roucher.bsky.social
Our newest blog post on @hf.co has you covered!
This post shows you how to use @arize-phoenix.bsky.social to trace and evaluate your smolagents.
Credit to @srichavali.bsky.social and @aymeric-roucher.bsky.social
February 28, 2025 at 5:19 PM
🤖 Building agents, but not sure how to measure their performance?
Our newest blog post on @hf.co has you covered!
This post shows you how to use @arize-phoenix.bsky.social to trace and evaluate your smolagents.
Credit to @srichavali.bsky.social and @aymeric-roucher.bsky.social
Our newest blog post on @hf.co has you covered!
This post shows you how to use @arize-phoenix.bsky.social to trace and evaluate your smolagents.
Credit to @srichavali.bsky.social and @aymeric-roucher.bsky.social