Opik

Opik is an open-source platform from Comet for logging, testing and monitoring LLM applications. You trace calls, build datasets, run automated evaluations and compare prompt versions in one place.

It includes LLM-as-judge metrics, a playground and an optimizer that suggests better prompts. You can self-host it or use Comet's cloud.

It is a good option for teams that already use Comet for experiment tracking and want the same habits for generative AI.