Portkey

Portkey routes requests to 200+ LLMs through one unified API, handling load balancing, fallbacks, and caching, and layering observability and guardrails on top of whichever provider you're actually using. Teams use it as the control plane between their application and however many different LLM providers they've ended up depending on.