About LiteLLM
LiteLLM is an AI gateway, open source, offering one unified interface for calling more than 100 LLM providers, including OpenAI, Anthropic, Gemini, Bedrock and Azure, using the OpenAI request format. It can be used as a Python SDK inside an application or deployed as a proxy server that serves a whole team or organization. The core is Python with a Rust component, and GitHub lists the license as 'Other'.
The project aims to remove the hassle of handling a separate SDK, login scheme, request format and set of errors for each model. On top of that the gateway provides load balancing, guardrails, spend tracking, virtual keys and an admin dashboard, and it exposes endpoints for chat completions, responses, embeddings, images, audio, batches and reranking.
Because requests keep the OpenAI format, teams can swap providers without rewriting application code. It is self-hosted, with hosted-proxy and enterprise tier options linked in the README, and its topics also reference an MCP gateway and LLMOps. It suits platform and AI engineering teams that need central control over model access, budgets and logging.
Key features
- Unified OpenAI-format interface for 100+ LLMs
- Python SDK and proxy server modes
- Virtual keys and spend tracking
- Guardrails and load balancing
- Built-in admin dashboard
- Endpoints for chat, embeddings, images and audio
Good fit for
- Central LLM gateway for a team
- Switching model providers without code changes
- Tracking spend across LLM usage
LiteLLM: questions and answers
- What is LiteLLM used for?
- LiteLLM is an open-source AI gateway and Python SDK that lets you call 100+ LLM providers through one OpenAI-style interface, with spend tracking and load balancing. It is a good fit for central LLM gateway for a team, switching model providers without code changes and tracking spend across LLM usage.
- Is LiteLLM open source?
- Yes. LiteLLM is open source under a custom licence. Its source code is on GitHub at BerriAI/litellm and is written mainly in Python.
- Is LiteLLM free?
- Yes. LiteLLM is open source, so the software itself is free to use under the terms of its own licence. A managed cloud version is also available.
- Can I self-host LiteLLM?
- Yes. LiteLLM can be self-hosted on your own server or infrastructure.
- What is LiteLLM an alternative to?
- LiteLLM is an open-source alternative to Amazon Bedrock, OpenRouter, Portkey and Azure AI Foundry. Other open-source alternatives to Amazon Bedrock include vLLM, Portkey AI Gateway and LLM Gateway.
- Is LiteLLM actively maintained?
- Yes. The most recent commit to LiteLLM was on 17 November 2026, and the latest release is v1.109.1, published on 12 November 2026. The project has 63k stars on GitHub, with 2k added in the last 30 days.
Open-source alternatives to LiteLLM
See all
vLLM
AI Infrastructure
A high-throughput and memory-efficient inference and serving engine for LLMs
Apache-2.0vs Amazon Bedrock★ 97k
Portkey AI Gateway
AI Infrastructure
A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardra
MITvs Amazon Bedrock★ 13k
Helicone
AI Infrastructure
🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and expe
Apache-2.0vs OpenRouter★ 6.3k
Ollama
AI Infrastructure
Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other model
MITvs ChatGPT★ 187k
LLM Gateway
AI Infrastructure
Route, manage, and analyze your LLM requests across multiple providers with a unified API
OSSvs Amazon Bedrock★ 1.7k
Hugging Face Chat UI
AI Tools
The open source codebase powering HuggingChat
Apache-2.0vs ChatGPT★ 11k
SaaS alternatives to LiteLLM
See all
Amazon Bedrock
AI Infrastructure
Managed AWS service for building generative AI apps with models from several providers
SaaS
OpenRouter
AI Infrastructure
Unified API gateway for accessing many large language models from one endpoint
SaaS
Portkey
AI Infrastructure
AI gateway and observability platform for managing LLM requests
SaaS
Azure AI Foundry
AI Infrastructure
Microsoft platform for building, evaluating and deploying AI apps and agents on Azure
SaaS
Bolt.new
AI Tools
Prompt-to-app builder that generates, runs and deploys full-stack web projects
SaaS
DeepInfra
AI Infrastructure
Pay-per-use API for running open-source AI models
SaaS

