Comet
@comet.com
End-to-end model evaluation platform for LLM evaluations, experiment tracking, and production monitoring
🧪 Explore the beta, open a PR and join the community.
Full announcement 👇
Full announcement 👇
Announcing Opik’s Guardrails Beta: Moderate LLM Applications in Real-Time
Build safer LLM apps with Opik's Guardrails—moderate output in real time with topic filters, PII detection, and support for third-party tools.
www.comet.com
May 27, 2025 at 4:54 PM
🧪 Explore the beta, open a PR and join the community.
Full announcement 👇
Full announcement 👇
🚀 This is only v0.1. We’re releasing early because we believe in building in the open.
🛠️ Coming soon: jailbreak detection, toxicity scoring, and deeper integrations with Opik’s evaluation tools.
🛠️ Coming soon: jailbreak detection, toxicity scoring, and deeper integrations with Opik’s evaluation tools.
May 27, 2025 at 4:54 PM
🚀 This is only v0.1. We’re releasing early because we believe in building in the open.
🛠️ Coming soon: jailbreak detection, toxicity scoring, and deeper integrations with Opik’s evaluation tools.
🛠️ Coming soon: jailbreak detection, toxicity scoring, and deeper integrations with Opik’s evaluation tools.
🛡️Meet Opik Guardrails (Public Beta) - a lightweight, open-source toolkit for real-time LLM output management:
⚠️Topic moderation via a fine-tuned BART model
🔎 PII detection built on Presidio
💪 Support for third-party guardrail libraries
⚠️Topic moderation via a fine-tuned BART model
🔎 PII detection built on Presidio
💪 Support for third-party guardrail libraries
May 27, 2025 at 4:54 PM
🛡️Meet Opik Guardrails (Public Beta) - a lightweight, open-source toolkit for real-time LLM output management:
⚠️Topic moderation via a fine-tuned BART model
🔎 PII detection built on Presidio
💪 Support for third-party guardrail libraries
⚠️Topic moderation via a fine-tuned BART model
🔎 PII detection built on Presidio
💪 Support for third-party guardrail libraries
Prompt engineering is evolving fast. We’re building tools that help you evolve with it 🔥
🛠️ Opik Agent Optimizer is open source — feedback, ideas, and PRs are all welcome.
Full announcement 👉https://www.comet.com/site/blog/automated-prompt-engineering/
🛠️ Opik Agent Optimizer is open source — feedback, ideas, and PRs are all welcome.
Full announcement 👉https://www.comet.com/site/blog/automated-prompt-engineering/
May 22, 2025 at 4:47 PM
Prompt engineering is evolving fast. We’re building tools that help you evolve with it 🔥
🛠️ Opik Agent Optimizer is open source — feedback, ideas, and PRs are all welcome.
Full announcement 👉https://www.comet.com/site/blog/automated-prompt-engineering/
🛠️ Opik Agent Optimizer is open source — feedback, ideas, and PRs are all welcome.
Full announcement 👉https://www.comet.com/site/blog/automated-prompt-engineering/
Ships with 4 optimizers – including 3 developed in-house:
🧠 MIPRO – meta-prompt optimizer
🧪 Meta Prompter Optimizer – LLM works as a prompt engineer
🎯 Bayesian Few-Shot Optimizer – finds optimal few-shot examples
🧬 Evolutionary Optimizer
🧠 MIPRO – meta-prompt optimizer
🧪 Meta Prompter Optimizer – LLM works as a prompt engineer
🎯 Bayesian Few-Shot Optimizer – finds optimal few-shot examples
🧬 Evolutionary Optimizer
May 22, 2025 at 4:47 PM
Ships with 4 optimizers – including 3 developed in-house:
🧠 MIPRO – meta-prompt optimizer
🧪 Meta Prompter Optimizer – LLM works as a prompt engineer
🎯 Bayesian Few-Shot Optimizer – finds optimal few-shot examples
🧬 Evolutionary Optimizer
🧠 MIPRO – meta-prompt optimizer
🧪 Meta Prompter Optimizer – LLM works as a prompt engineer
🎯 Bayesian Few-Shot Optimizer – finds optimal few-shot examples
🧬 Evolutionary Optimizer
🤝 Meet Opik Agent Optimizer, now in public beta 🎉
A new SDK in Comet’s open-source Opik framework to automate prompt and agent tuning.
✅ Framework-agnostic
✅ Model-agnostic
✅ Plugs into any LLM stack
✅ Powered by Opik’s eval capabilities
A new SDK in Comet’s open-source Opik framework to automate prompt and agent tuning.
✅ Framework-agnostic
✅ Model-agnostic
✅ Plugs into any LLM stack
✅ Powered by Opik’s eval capabilities
May 22, 2025 at 4:47 PM
🤝 Meet Opik Agent Optimizer, now in public beta 🎉
A new SDK in Comet’s open-source Opik framework to automate prompt and agent tuning.
✅ Framework-agnostic
✅ Model-agnostic
✅ Plugs into any LLM stack
✅ Powered by Opik’s eval capabilities
A new SDK in Comet’s open-source Opik framework to automate prompt and agent tuning.
✅ Framework-agnostic
✅ Model-agnostic
✅ Plugs into any LLM stack
✅ Powered by Opik’s eval capabilities
Mirror lets teens:
📝Express themselves through writing, voice, images, or video
☀️ Track their moods
💡Get guided prompts to process feelings
Learn more 🔗
📝Express themselves through writing, voice, images, or video
☀️ Track their moods
💡Get guided prompts to process feelings
Learn more 🔗
Mirror | Your Private Space to Self-Reflect
Mirror is a mental health journal, designed by leading experts to support the unique needs of young people.
www.mirrorjournal.com
April 4, 2025 at 6:29 PM
Mirror lets teens:
📝Express themselves through writing, voice, images, or video
☀️ Track their moods
💡Get guided prompts to process feelings
Learn more 🔗
📝Express themselves through writing, voice, images, or video
☀️ Track their moods
💡Get guided prompts to process feelings
Learn more 🔗
Reposted by Comet
I used the LLM Jury to automatically evaluate my outputs using @comet.com's Opik, a free, 100% open-source LLM evaluation framework.
⭐️ Check it out and give it a star if you like what you see: (6/6)
github.com/comet-ml/opik
⭐️ Check it out and give it a star if you like what you see: (6/6)
github.com/comet-ml/opik
GitHub - comet-ml/opik: Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.
Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards. - comet-ml/opik
github.com
February 24, 2025 at 6:31 PM
I used the LLM Jury to automatically evaluate my outputs using @comet.com's Opik, a free, 100% open-source LLM evaluation framework.
⭐️ Check it out and give it a star if you like what you see: (6/6)
github.com/comet-ml/opik
⭐️ Check it out and give it a star if you like what you see: (6/6)
github.com/comet-ml/opik
📅 March 6 | 1-2 PM EST
🔗 Register: aws-experience.com/amer/smb/e/8...
🔗 Register: aws-experience.com/amer/smb/e/8...
aws-experience.com
February 20, 2025 at 7:05 PM
📅 March 6 | 1-2 PM EST
🔗 Register: aws-experience.com/amer/smb/e/8...
🔗 Register: aws-experience.com/amer/smb/e/8...