AI Gateway | Enterprise Standard for LLMs -- LiteLLM (original) (raw)

🚅 LiteLLM

• LLM Gateway
• Budgets & Rate Limits
• MCP Gateway
• RBAC & Usage Tracking by Key, Team, Org
• Agent Gateway
• Logging to Datadog & OpenTelemetry
• Built-in and 3rd Party Guardrails
• OIDC, SSO, Custom Authentication

Deploy in any environment

On-prem

Multi-Cloud

Kubernetes

Helm

Features

Delegate access

LiteLLM Enterprise allows you to delegate access of teams and organizations to admins. Reducing the time you spend managing the proxy.

Generate tokens on the fly

With OIDC/JWT Auth and 'group-based access', developers can generate temporary tokens to call models via LiteLLM. Reducing time spent managing keys and model access.

Monitor Proxy in Production

LiteLLM Enterprise provides Prometheus Metrics, Support with SLA's, and additional alerting features, to help you guarantee reliability in production.

Trusted by