No direct Voltage Park replacements listed yet
Open-source AI infrastructure tools. To compare with Voltage Park.
60 open-source AI infrastructure tools

WeKnora
AI Infrastructure
Open-source LLM knowledge platform: turn raw documents into a queryable RAG, an autonomous
OSS★ 37k
Ollama
AI Infrastructure
Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other model
MITvs ChatGPT★ 187k
vLLM
AI Infrastructure
A high-throughput and memory-efficient inference and serving engine for LLMs
Apache-2.0vs Amazon Bedrock★ 97k
llama.cpp
AI Infrastructure
LLM inference in C/C++
MITvs OpenAI API Platform★ 134k
Dify
AI Infrastructure
Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collabo
OSSvs Gumloop★ 161k
New API
AI Infrastructure
A unified AI model hub for aggregation & distribution. It supports cross-converting variou
AGPL-3.0vs OpenRouter★ 52k
SGLang
AI Infrastructure
SGLang is a high-performance serving framework for large language models and multimodal mo
Apache-2.0vs Amazon Bedrock★ 39k
LiteLLM
AI Infrastructure
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (o
OSSvs Amazon Bedrock★ 63k
Langfuse
AI Infrastructure
Trace, evaluate, and improve AI agents with one open platform. Use production data to unde
OSSvs Weights & Biases★ 37k
RAGFlow
AI Infrastructure
RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cu
Apache-2.0vs Vectara★ 94k
Langflow
AI Infrastructure
Langflow is a powerful tool for building and deploying AI-powered agents and workflows.
MITvs Gumloop★ 157k
Promptfoo
AI Infrastructure
Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI.
MITvs Braintrust★ 27k
Unsloth
AI Infrastructure
Unsloth is an open-source framework for running and training LLMs.
Apache-2.0vs Together AI★ 79k
TraceRoot
AI Infrastructure
TraceRoot - open source self improving layer for ai agents YC S25
OSSvs Weights & Biases★ 1.4k
Opik
AI Infrastructure
Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows wit
Apache-2.0vs Weights & Biases★ 23k
LocalAI
AI Infrastructure
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video -
MITvs ChatGPT★ 50k
Rome
AI Infrastructure
A compounding agent OS for recursive agents. Also an open source alternative to Grok Bot a
MITvs Grok★ 898
KiwiFS
AI Infrastructure
Markdown filesystem for agents and teams.
OSS★ 877
Arize Phoenix
AI Infrastructure
AI Observability & Evaluation
OSSvs Weights & Biases★ 12k
Qdrant
Databases
Qdrant - High-performance, massive-scale Vector Database and Vector Search Engine for the
Apache-2.0vs Pinecone★ 36k
Microsandbox
AI Infrastructure
Easy, fast microVMs for untrusted workloads
Apache-2.0★ 9k
PrivateGPT
AI Infrastructure
Complete API layer for private AI applications on local models: RAG, skills, tools, MCP, t
Apache-2.0vs ChatGPT★ 58k
RD-Agent
AI Infrastructure
Research and development (R&D) is crucial for the enhancement of industrial productivity,
MIT★ 15k
MLflow
AI Infrastructure
The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables te
Apache-2.0vs Weights & Biases★ 29k
llamafile
AI Infrastructure
Distribute and run LLMs with a single file.
OSSvs ChatGPT★ 27k
Sim
AI Infrastructure
Sim is the collaborative workspace to build, deploy, and monitor AI agents and workflows.
Apache-2.0vs Gumloop★ 30k
Label Studio
AI Infrastructure
Label Studio is a multi-type data labeling and annotation tool with standardized output fo
Apache-2.0vs Roboflow★ 29k
Yuxi
AI Infrastructure
可私有部署的多租户知识智能体平台,统一知识库、知识图谱、多智能体执行、MCP/Skills、沙盒与权限管理。
MIT★ 7.7k
Chroma
Databases
Search infrastructure for AI
Apache-2.0vs Pinecone★ 30k
OpenConnector
AI Infrastructure
Connect Gmail, GitHub, Notion, and 1500+ apps through OOMOL, then use those connections in
Apache-2.0★ 6.2k
MLC LLM
AI Infrastructure
Universal LLM Deployment Engine with ML Compilation
Apache-2.0★ 23k
Trigger.dev
Workflow Automation
Trigger.dev – build and deploy durable AI agents and workflows
Apache-2.0vs IFTTT★ 17k
CVAT
AI Infrastructure
Computer Vision Annotation Tool (CVAT) is a leading platform for building high-quality vis
MITvs Roboflow★ 17k
LanceDB
Databases
Developer-friendly OSS embedded retrieval library for multimodal AI. Search More; Manage L
Apache-2.0vs Pinecone★ 12k
MCP Toolbox
AI Infrastructure
MCP Toolbox for Databases is an open source MCP server for databases.
Apache-2.0vs Connect★ 17k
Obot
AI Infrastructure
Complete AI Governance Platform from Obot AI
MIT★ 1.2k
Weaviate
Databases
Weaviate is an open-source vector database that stores both objects and vectors, allowing
OSSvs Pinecone★ 17k
Flyte
AI Tools
Type-safe, distributed orchestration of agents, ML pipelines, and real-time inference on y
Apache-2.0vs Amazon SageMaker★ 7.8kGPT-Load
AI Infrastructure
Self-hosted AI gateway for scheduling API keys and subscription accounts across 35 channel
MIT★ 7.2k
Laminar
AI Infrastructure
Laminar - open-source observability platform purpose-built for AI agents. YC S24.
Apache-2.0vs Weights & Biases★ 3.5k
Nvidia
AI Infrastructure
The Triton Inference Server provides an optimized cloud and edge inferencing solution.
BSD-3-Clausevs Fireworks AI★ 11k
AnythingMCP
AI Infrastructure
Open-source, self-hosted MCP gateway: turn any REST/OpenAPI, SOAP, GraphQL, OData or SQL A
AGPL-3.0★ 776
HelixDB
Databases
HelixDB is an OLTP graph database with native vector and full-text search built in Rust on
Apache-2.0vs Amazon Neptune★ 6.3k
Docs MCP Server
Developer Tools
Grounded Docs MCP Server: Open-Source Alternative to Context7, Nia, and Ref.Tools
MIT★ 1.9k
BentoML
AI Infrastructure
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM
Apache-2.0vs Amazon SageMaker★ 8.9k
LangWatch
AI Infrastructure
The platform for LLM evaluations and AI agent testing
Apache-2.0vs LangSmith★ 5k
Astron Agent
AI Infrastructure
Enterprise-grade, commercial-friendly agentic workflow platform for building next-generati
Apache-2.0★ 8.9k
Vespa
Search
The AI search platform
Apache-2.0vs Elastic★ 7.2k
Helicone
AI Infrastructure
🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and expe
Apache-2.0vs OpenRouter★ 6.3k
Wigolo
Search
The go-to web for your AI coding agent — local-first search, fetch, crawl & research over
OSSvs Tavily★ 5.5k
One API
AI Infrastructure
LLM API 管理 & 分发系统,支持 OpenAI、Azure、Anthropic Claude、Google Gemini、DeepSeek、字节豆包、ChatGLM、文心一
MITvs OpenRouter★ 37k
Argilla
AI Tools
Argilla is a collaboration tool for AI engineers and domain experts to build high-quality
Apache-2.0vs Encord★ 5.2k
Olares
Infrastructure & Containers
Open-Source Personal Cloud OS for Always-On Agents
AGPL-3.0★ 5.4k
RWKV-Runner
AI Infrastructure
A RWKV management and startup tool, full automation, only 8MB. And provides an interface c
MIT★ 6.5k
Zenml
AI Tools
ZenML 🙏: One AI Platform from Pipelines to Agents. https://zenml.io.
Apache-2.0vs Vellum★ 5.6k
LLM Gateway
AI Infrastructure
Route, manage, and analyze your LLM requests across multiple providers with a unified API
OSSvs Amazon Bedrock★ 1.7k
Infinity
Databases
The AI-native database built for LLM applications, providing incredibly fast hybrid search
Apache-2.0vs Pinecone★ 4.8k
Inkeep Agents
AI Infrastructure
Create AI Agents in a No-Code Visual Builder or TypeScript SDK with full 2-way sync. For s
OSS★ 1.5k
Pipelines
Infrastructure & Containers
Machine Learning Pipelines for Kubeflow
Apache-2.0vs Amazon SageMaker★ 4.3k
beta9
AI Infrastructure
Ultrafast serverless GPU inference, sandboxes, and background jobs
AGPL-3.0vs Modal★ 1.9k
See every AI infrastructure tool or the Voltage Park listing.
