Opik
Open-source LLM evaluation and testing framework by Comet ML for tracing and evals.
Free (open source)
View on GitHub - Category
- Analytics & Monitoring
- Pricing
- Free (open source)
- Vendor
- Comet ML
- Website
- github.com
About Opik
Opik is an open-source LLM evaluation platform from Comet ML. Trace and evaluate LLM applications with automated scoring, hallucination detection, dataset management, and a CI/CD-friendly evaluation SDK for continuous quality checks.
What you get
- LLM tracing & logging
- Automated evaluation scoring
- Hallucination detection
- Dataset management
- CI/CD evaluation SDK
- Self-hostable
Specifications
| LLM Tracing | Yes |
|---|---|
| Evaluation | Yes |
| Self-Host | Yes |
| Open Source | Yes |
| Alerting | No |
| Starting Price | Free |