LiteLLM (original) (raw)

Give Developers

• Azure Access

• Gemini Access

• Bedrock Access

• OpenAI Access

• Anthropic Access

AI Gateway to provide model access, fallbacks and spend tracking across 100+ LLMs. All in the OpenAI format.

🚅 LiteLLM

What is LiteLLM?

LiteLLM simplifies model access, spend tracking and fallbacks across 100+ LLMs. Watch this demo, to learn more.

Features

• 100+ LLM Provider Integrations
• Langfuse, Arize Phoenix, Langsmith, OTEL Logging
• Virtual Keys, Budgets, Teams
• Load Balancing, RPM/TPM limits
• LLM Guardrails

For giving LLM access to a large number of developers and projects.

• Everything in OSS
• Enterprise Support + Custom SLAs
• JWT Auth, SSO, Audit Logs
• All Enterprise Features - Docs