LLM Evaluation

Open-source tracing and evaluation for LLM apps

Pytest-style open-source framework for testing LLM apps

Comet's open-source LLM tracing and evaluation suite

Evaluation and guardrails for generative AI in production

Simulation and evaluation platform for AI agents

Open-source evaluation and tracking for LLM experiments

Observability and evaluation for AI agents

Observability for LLM apps built on OpenTelemetry

Testing and validation for ML and LLM systems

AI performance monitoring with an open-source evaluation engine

Open-source tracing and evals for AI agents