LiteLLM

LiteLLM gives developers a single, standardized interface for calling over 100 LLM APIs — OpenAI, Anthropic, Google, open-source models — with retries, load balancing, cost tracking, and fallbacks handled automatically across providers. It's a small library that solves a real annoyance: every provider's API looks slightly different, and LiteLLM makes them all look the same.