168 tools · 86 open-source · 82 SaaS
The best AI infrastructure tools. Ranked by real activity.
The top-ranked open-source AI infrastructure tool on Enlisted is Ollama (182k GitHub stars), followed by Dify and Langflow. Among SaaS products, other tools on Enlisted are most often compared with Weights & Biases, Amazon SageMaker and LangSmith.
Enlisted lists 168 AI infrastructure tools: 86 open source and 82 SaaS. 74 of the open-source ones can be self-hosted on your own server or computer. The most common open-source licences here are Apache-2.0 (42 tools), MIT (22) and AGPL-3.0 (6). The open-source ones are most often listed as alternatives to Weights & Biases, LangSmith and Pinecone.
Last updated October 3, 2026 · ranked by GitHub stars, growth and recent commits
The top 48 of 168 AI infrastructure tools
Ollama
AI Infrastructure
Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other model
MITvs ChatGPT★ 182k
Dify
AI Infrastructure
Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collabo
OSSvs Gumloop★ 158k
Langflow
AI Infrastructure
Langflow is a powerful tool for building and deploying AI-powered agents and workflows.
MITvs Gumloop★ 155k
llama.cpp
AI Infrastructure
LLM inference in C/C++
MITvs OpenAI API Platform★ 130k
vLLM
AI Infrastructure
A high-throughput and memory-efficient inference and serving engine for LLMs
Apache-2.0vs Amazon Bedrock★ 93k
RAGFlow
AI Infrastructure
RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cu
Apache-2.0vs Vectara★ 92k
Unsloth
AI Infrastructure
Unsloth is an open-source framework for running and training LLMs.
Apache-2.0vs Together AI★ 77k
LiteLLM
AI Infrastructure
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (o
OSSvs Amazon Bedrock★ 60k
PrivateGPT
AI Infrastructure
Complete API layer for private AI applications on local models: RAG, skills, tools, MCP, t
Apache-2.0vs ChatGPT★ 58k
whisper.cpp
AI Infrastructure
Port of OpenAI's Whisper model in C/C++
MITvs Deepgram★ 54k
LocalAI
AI Infrastructure
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video -
MITvs ChatGPT★ 49k
New API
AI Infrastructure
A unified AI model hub for aggregation & distribution. It supports cross-converting variou
AGPL-3.0vs OpenRouter★ 49k
exo
AI Infrastructure
Run frontier AI locally.
Apache-2.0★ 48k
Whisper
AI Infrastructure
Robust Speech Recognition via Large-Scale Weak Supervision
MITvs Deepgram★ 110k
SGLang
AI Infrastructure
SGLang is a high-performance serving framework for large language models and multimodal mo
Apache-2.0vs Amazon Bedrock★ 37k
Langfuse
AI Infrastructure
Trace, evaluate, and improve AI agents with one open platform. Use production data to unde
OSSvs Weights & Biases★ 35k
Qdrant
Databases
Qdrant - High-performance, massive-scale Vector Database and Vector Search Engine for the
Apache-2.0vs Pinecone★ 35k
WeKnora
AI Infrastructure
Open-source LLM knowledge platform: turn raw documents into a queryable RAG, an autonomous
OSS★ 32k
Chroma
Databases
Search infrastructure for AI
Apache-2.0vs Pinecone★ 29k
Sim
AI Infrastructure
Sim is the collaborative workspace to build, deploy, and monitor AI agents and workflows.
Apache-2.0vs Gumloop★ 30k
Label Studio
AI Infrastructure
Label Studio is a multi-type data labeling and annotation tool with standardized output fo
Apache-2.0vs Roboflow★ 28k
MLflow
AI Infrastructure
The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables te
Apache-2.0vs Weights & Biases★ 28k
llamafile
AI Infrastructure
Distribute and run LLMs with a single file.
OSSvs ChatGPT★ 26k
Promptfoo
AI Infrastructure
Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI.
MITvs Braintrust★ 26k
MLC LLM
AI Infrastructure
Universal LLM Deployment Engine with ML Compilation
Apache-2.0★ 23k
Opik
AI Infrastructure
Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows wit
Apache-2.0vs Weights & Biases★ 22k
CVAT
AI Infrastructure
Computer Vision Annotation Tool (CVAT) is a leading platform for building high-quality vis
MITvs Roboflow★ 17k
Weaviate
Databases
Weaviate is an open-source vector database that stores both objects and vectors, allowing
OSSvs Pinecone★ 17k
MCP Toolbox
AI Infrastructure
MCP Toolbox for Databases is an open source MCP server for databases.
Apache-2.0vs Connect★ 17k
Trigger.dev
Workflow Automation
Trigger.dev – build and deploy durable AI agents and workflows
Apache-2.0★ 16k
RD-Agent
AI Infrastructure
Research and development (R&D) is crucial for the enhancement of industrial productivity,
MIT★ 15k
Arize Phoenix
AI Infrastructure
AI Observability & Evaluation
OSSvs Weights & Biases★ 12k
LanceDB
Databases
Developer-friendly OSS embedded retrieval library for multimodal AI. Search More; Manage L
Apache-2.0vs Pinecone★ 12k
Astron Agent
AI Infrastructure
Enterprise-grade, commercial-friendly agentic workflow platform for building next-generati
Apache-2.0★ 8.9k
Microsandbox
AI Infrastructure
Easy, fast microVMs for untrusted workloads
Apache-2.0★ 8.5k
Rasa
AI Infrastructure
💬 Open source machine learning framework to automate text- and voice-based conversation
Apache-2.0vs Voiceflow★ 21k
Yuxi
AI Infrastructure
可私有部署的多租户知识智能体平台，统一知识库、知识图谱、多智能体执行、MCP/Skills、沙盒与权限管理。
MIT★ 7.3kGPT-Load
AI Infrastructure
Self-hosted AI gateway for scheduling API keys and subscription accounts across 35 channel
MIT★ 7k
Vespa
Search
The AI search platform
Apache-2.0vs Elastic★ 7.1k
ODS
AI Infrastructure
Just a chat full of self-hosters running or trying to run ODS. | 1583 members
Apache-2.0★ 7k
RWKV-Runner
AI Infrastructure
A RWKV management and startup tool, full automation, only 8MB. And provides an interface c
MIT★ 6.5k
Helicone
AI Infrastructure
🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and expe
Apache-2.0vs OpenRouter★ 6.2k
HelixDB
Databases
HelixDB is an OLTP graph database with native vector and full-text search built in Rust on
Apache-2.0vs Amazon Neptune★ 6.1k
One API
AI Infrastructure
LLM API 管理 & 分发系统，支持 OpenAI、Azure、Anthropic Claude、Google Gemini、DeepSeek、字节豆包、ChatGLM、文心一
MITvs OpenRouter★ 37k
OpenConnector
AI Infrastructure
Open-source auth gateway connecting 1500+ SaaS providers to AI agents through SDK, CLI, MC
Apache-2.0★ 5.9k
Wigolo
Search
The go-to web for your AI coding agent — local-first search, fetch, crawl & research over
OSSvs Tavily★ 5.4k
Olares
Infrastructure & Containers
Open-Source Personal Cloud OS for Always-On Agents
AGPL-3.0★ 5.3k
LangWatch
AI Infrastructure
The platform for LLM evaluations and AI agent testing
Apache-2.0vs LangSmith★ 4.9k
AI infrastructure tools: questions
- What is the best open-source AI infrastructure tool?
- Ollama is the top-ranked open-source AI infrastructure tool on Enlisted, with 182k GitHub stars. It is followed by Dify, Langflow and llama.cpp.
- What are the best free AI infrastructure tools?
- The top-ranked open-source AI infrastructure tools with a standard licence are Ollama (MIT), Langflow (MIT) and llama.cpp (MIT), so their code is free to use. 37 of the 82 SaaS products here have a free plan, including Weights & Biases, LangSmith and Portkey.
- Which AI infrastructure tools can be self-hosted?
- 74 of the 86 open-source AI infrastructure tools on Enlisted can be self-hosted on your own server or computer; the top-ranked are Ollama, Dify and Langflow.
- How are these AI infrastructure tools ranked?
- Open-source tools are ordered by a score built from GitHub stars, star growth over the last 30 days and how recently the code changed; 65 of the 86 had new commits or a release in the last 30 days. SaaS products have no public repository, so they get a fixed baseline score. GitHub data is refreshed daily, and nobody can pay to move up.