LiteLLM
LiteLLM is an open-source Python SDK and self-hosted gateway that calls many language model providers through the OpenAI API format.
What LiteLLM does
LiteLLM has two parts. The Python SDK is a library that calls more than 100 model providers, among them OpenAI, Anthropic, Vertex AI and Bedrock, using the OpenAI request format, with a router for retries, fallbacks and load balancing. The proxy server is a gateway a team runs itself: applications send requests to it, and it issues virtual keys, applies budgets and rate limits per key, team or user, tracks spend, logs requests and responses, and has an admin interface.
There is no hosted version. The gateway is deployed on the buyer's own infrastructure with the vendor's Helm charts, Terraform modules for AWS and Google Cloud, or plain Kubernetes manifests. It needs PostgreSQL for keys, teams, users and spend logs, and Redis once more than one instance is running.
LiteLLM: owner, license and hosting
| Fact | Value | Source and date checked |
|---|---|---|
| Owner | Berrie AI Incorporated, as the site's copyright notice spells it. | SOURCE ↗ |
| License | MIT, except the enterprise/ directory, which is under a separate enterprise license. | SOURCE ↗ |
| Self-hosting | Yes, and it is the only way to run it. Helm charts, Terraform modules for AWS (ECS Fargate) and Google Cloud (Cloud Run), or Kubernetes manifests. Needs PostgreSQL, and Redis for more than one instance. | SOURCE ↗ |
| Hosted regions | None. No hosted service is offered; the pricing page describes LiteLLM as self-hosted. | SOURCE ↗ |
Each value was read from the vendor's own page on the date shown. How listings are checked
LiteLLM plans and prices
LiteLLM pricing, checked on . Lowest paid plan: Enterprise: no price is published; quoted by sales. A 30-day trial key is offered. Free tier: Open Source: $0, self-hosted, with no license fee and no stated usage limit. Pricing model: The open-source gateway is free to self-host. Enterprise is an annual contract sized to annual gateway request capacity, deployment architecture and support needs, not per token.
| Plan | Price | Included usage | Beyond that | Data retention | Users |
|---|---|---|---|---|---|
| Open Source | $0 | – | – | – | – |
| Enterprise | Annual contract, quoted by sales | – | – | – | – |
Neither plan states included usage, data retention or a user limit; the software is self-hosted, so retention is whatever the operator configures. The page says Enterprise pricing is sized to annual gateway request capacity, deployment architecture and support needs, "never per token", with volume discount tiers. It offers a 30-day Enterprise trial key with no credit card, and says Enterprise can be bought directly, through AWS Marketplace or through resellers. The page's FAQ mentions "Enterprise Standard and SCALE" but the page does not describe them as separate plans.
As stated on the vendor's pricing page on . A dash means the page does not say.
LiteLLM pricing history
The pricing page has been checked daily since . No price change has been recorded since then.
Where LiteLLM fits
Teams that want a gateway on their own infrastructure with no license fee: the code outside the enterprise/ directory is MIT-licensed, and the open-source plan includes virtual keys, budgets, rate limits, spend tracking and fallbacks. It also suits Python applications that only need the SDK and no separate service.
Limits of LiteLLM
There is no hosted service, so the team runs and upgrades the gateway, PostgreSQL and, beyond one instance, Redis. SSO, SCIM, audit logs and secret-manager integration are in the Enterprise plan, which is an annual contract with no published price. The key that encrypts stored provider credentials cannot be rotated once models have been added.
Other gateways and observability tools
-
Langfuse
Langfuse is an open-source platform for tracing, evaluating and managing prompts in applications built on language models.
-
OpenRouter
OpenRouter is a hosted API that routes requests to language models from many providers through one endpoint and one prepaid credit balance.