Traceloop

Traceloop offers monitoring for LLM applications using open standards. Its instrumentation library, OpenLLMetry, captures traces for model calls and frameworks and sends them to whatever backend you already use, or to Traceloop's own dashboard.

Evaluation features let you score outputs and watch for regressions. Because it uses OpenTelemetry, you avoid being locked to one vendor.

It fits teams that already run observability tools and want AI traces in the same place.