About New API
New API is an AI gateway you host yourself, built for apps, agents and teams. It lets you plug in upstream model services, present one consistent API to clients, and handle routing, access, usage and cost management centrally. It is written in Go and released under the AGPL-3.0 license.
It can convert between formats so that various LLMs are reachable through OpenAI-compatible, Claude-compatible or Gemini-compatible interfaces. Supported upstreams range from OpenAI, Anthropic and Gemini to Azure OpenAI, AWS Bedrock, Vertex AI, DeepSeek and Qwen, plus other compatible services, and a web console is used for administration.
Typical uses are sharing authorized model access across a team, switching providers without reconfiguring every client, and operating a private multi-model service. The README stresses lawful, authorized use: users must obtain upstream keys legitimately, follow upstream terms, and meet any regulatory obligations if they offer AI services to the public. It suits teams and organizations that need centralized model management.
Key features
- Unified gateway for multiple upstream model services
- OpenAI, Claude and Gemini compatible formats
- Routing, access control and usage tracking
- Cost accounting and usage analytics
- Web console for administration
- Self-hosted private deployment
Good fit for
- →Sharing model access across a team
- →Switching providers without changing clients
- →Private multi-model service
- Built with
- Go
- Tags
- ai-gateway
- llm
- openai-compatible
- api-management
- golang
- self-hosted
- model-routing
- usage-analytics
Open-source alternatives to New API
See all
LiteLLM
AI Infrastructure
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (o
OSSvs Amazon Bedrock★ 60k
Helicone
AI Infrastructure
🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and expe
Apache-2.0vs OpenRouter★ 6.2k
One API
AI Infrastructure
LLM API 管理 & 分发系统,支持 OpenAI、Azure、Anthropic Claude、Google Gemini、DeepSeek、字节豆包、ChatGLM、文心一
MITvs OpenRouter★ 37k
Portkey AI Gateway
AI Infrastructure
A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardra
MITvs Amazon Bedrock★ 13k
LLM Gateway
AI Infrastructure
Route, manage, and analyze your LLM requests across multiple providers with a unified API
OSSvs Amazon Bedrock★ 1.7k
LocalAI
AI Infrastructure
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video -
MITvs ChatGPT★ 49k
SaaS alternatives to New API
See all
OpenRouter
AI Infrastructure
Unified API gateway for accessing many large language models from one endpoint
SaaS
Portkey
AI Infrastructure
AI gateway and observability platform for managing LLM requests
SaaS
Fireworks AI
AI Infrastructure
Inference platform for running and fine-tuning generative AI models at low latency
SaaS
Vellum
AI Infrastructure
Platform for building, testing and monitoring LLM prompts and workflows
SaaS
Braintrust
AI Infrastructure
Evaluation and observability platform for building and testing AI applications
SaaS
DeepInfra
AI Infrastructure
Pay-per-use API for running open-source AI models
SaaS

