LLM Gateway

Open source

An open-source API gateway that routes requests to many LLM providers through one OpenAI-compatible interface, with usage analytics and key management.

Open-source alternative to

llmgateway.io
LLM Gateway homepage screenshot
GitHub stars
1.7k
Last 30 days
+52(+3%)
Last commit
today
Repository age
19 months
Version
v1.25.0
Licence
Custom
Self-hosted
Yes

About LLM Gateway

LLM Gateway is an open-source API gateway for large language models. It sits between your applications and multiple providers such as OpenAI, Anthropic and Google Vertex AI, so your code talks to one interface while the gateway decides where each request goes. Its API follows the OpenAI format, which keeps migration from existing code straightforward.

Beyond routing, it centralizes the management of provider API keys and tracks requests, token usage, response times and costs so teams can see what their LLM usage is doing. Performance monitoring lets you compare models on speed and cost-effectiveness. Topics on the repository also mention guardrails, rate limiting, observability and enterprise use.

You can use LLM Gateway in two ways: a hosted version at llmgateway.io where you create an account and get an API key, or a self-hosted deployment on your own infrastructure using a unified Docker image with PostgreSQL. The code is written in TypeScript and its licence is listed as other, so check the repository terms. It suits developers and platform teams who juggle several model vendors.

Key features

  • Unified OpenAI-compatible API
  • Routing across multiple LLM providers
  • Central management of provider API keys
  • Token usage and cost tracking
  • Model performance comparison
  • Docker image for self-hosting

Good fit for

  • Switching between model vendors without code changes
  • Tracking LLM spend across applications
  • Self-hosting a gateway for data control
Tags
llm-gateway
api-gateway
openai-compatible
analytics
observability
api-keys
multi-provider
typescript
self-hosted

LLM Gateway: questions and answers

What is LLM Gateway used for?
LLM Gateway is an open-source API gateway that routes requests to many LLM providers through one OpenAI-compatible interface, with usage analytics and key management. It is a good fit for switching between model vendors without code changes, tracking LLM spend across applications and self-hosting a gateway for data control.
Is LLM Gateway open source?
Yes. LLM Gateway is open source under a custom licence. Its source code is on GitHub at theopenco/llmgateway and is written mainly in TypeScript.
Is LLM Gateway free?
Yes. LLM Gateway is open source, so the software itself is free to use under the terms of its own licence. A managed cloud version is also available.
Can I self-host LLM Gateway?
Yes. LLM Gateway can be self-hosted on your own server or infrastructure.
What is LLM Gateway an alternative to?
LLM Gateway is an open-source alternative to Amazon Bedrock, OpenRouter and Portkey. Other open-source alternatives to Amazon Bedrock include LiteLLM, Portkey AI Gateway and vLLM.
Is LLM Gateway actively maintained?
Yes. The most recent commit to LLM Gateway was on 13 November 2026, and the latest release is v1.25.0, published on 9 November 2026. The project has 1.7k stars on GitHub, with 52 added in the last 30 days.

Open-source alternatives to LLM Gateway

See all

SaaS alternatives to LLM Gateway

See all