222 tools · 88 open-source · 134 SaaS
The best AI infrastructure tools. Page 2 of 5.
Last updated November 13, 2026 · ranked by GitHub stars, growth and recent commits
AI infrastructure tools 49–96 of 222

Helicone
AI Infrastructure
🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and expe
Apache-2.0vs OpenRouter★ 6.3k
Wigolo
Search
The go-to web for your AI coding agent — local-first search, fetch, crawl & research over
OSSvs Tavily★ 5.5k
One API
AI Infrastructure
LLM API 管理 & 分发系统,支持 OpenAI、Azure、Anthropic Claude、Google Gemini、DeepSeek、字节豆包、ChatGLM、文心一
MITvs OpenRouter★ 37k
Argilla
AI Tools
Argilla is a collaboration tool for AI engineers and domain experts to build high-quality
Apache-2.0vs Encord★ 5.2k
Olares
Infrastructure & Containers
Open-Source Personal Cloud OS for Always-On Agents
AGPL-3.0★ 5.4k
RWKV-Runner
AI Infrastructure
A RWKV management and startup tool, full automation, only 8MB. And provides an interface c
MIT★ 6.5k
Zenml
AI Tools
ZenML 🙏: One AI Platform from Pipelines to Agents. https://zenml.io.
Apache-2.0vs Vellum★ 5.6k
LLM Gateway
AI Infrastructure
Route, manage, and analyze your LLM requests across multiple providers with a unified API
OSSvs Amazon Bedrock★ 1.7k
Infinity
Databases
The AI-native database built for LLM applications, providing incredibly fast hybrid search
Apache-2.0vs Pinecone★ 4.8k
Inkeep Agents
AI Infrastructure
Create AI Agents in a No-Code Visual Builder or TypeScript SDK with full 2-way sync. For s
OSS★ 1.5k
Pipelines
Infrastructure & Containers
Machine Learning Pipelines for Kubeflow
Apache-2.0vs Amazon SageMaker★ 4.3k
beta9
AI Infrastructure
Ultrafast serverless GPU inference, sandboxes, and background jobs
AGPL-3.0vs Modal★ 1.9k
CML
CI/CD & DevOps
♾️ CML - Continuous Machine Learning | CI/CD for ML
Apache-2.0vs Valohai★ 4.2k
Portkey AI Gateway
AI Infrastructure
A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardra
MITvs Amazon Bedrock★ 13k
Rasa
AI Infrastructure
💬 Open source machine learning framework to automate text- and voice-based conversation
Apache-2.0vs Voiceflow★ 21k
Pezzo
AI Infrastructure
🕹️ Open-source, developer-first LLMOps platform designed to streamline prompt design, ver
Apache-2.0vs Weights & Biases★ 3.3k
Nndeploy
AI Infrastructure
一款简单易用和高性能的AI部署框架 | An Easy-to-Use and High-Performance AI Deployment Framework
Apache-2.0★ 1.9k
Paddler
AI Infrastructure
Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at
Apache-2.0★ 1.7k
OpenPAI
AI Infrastructure
Resource scheduling and cluster management for AI
MITvs Azure Machine Learning★ 2.7k
Ktx
AI Infrastructure
ktx is an executable context layer for data and analytics agents 🐙 Allow Claude Code, Cod
Apache-2.0★ 1.6k
MLRun
AI Infrastructure
MLRun is an open source MLOps platform for quickly building and managing continuous ML app
Apache-2.0vs Amazon SageMaker★ 1.7k
CoAI
AI Infrastructure
🚀 Next Gen Multi-tenant AI One-Stop Solution. Builtin Admin & Billing System. Enterprise-
Apache-2.0★ 9.3k
Observal
AI Infrastructure
Observal is self-hosted registry for your coding agent extensions with a built in insight
Apache-2.0★ 4.3k
JamAI Base
AI Infrastructure
The collaborative spreadsheet for AI. Chain cells into powerful pipelines, experiment with
Apache-2.0★ 1.1k
Backend.AI
AI Infrastructure
Backend.AI is a streamlined, container-based computing cluster platform that hosts popular
LGPL-3.0vs RunPod★ 680
AppPlatform
AI Infrastructure
AppPlatform 是一个前沿的大模型应用工程,旨在通过集成的声明式编程和低代码配置工具,简化和优化大模型的训练与推理应用的开发过程。本工程为软件工程师和产品经理提供一个强大的
MIT★ 1.5k
Trieve
Search
All-in-one platform for search, recommendations, RAG, and analytics offered via API
MITvs Algolia★ 2.7k
1Backend
Backend as a Service
Build AI (or any) apps with scalable microservices & microfrontends.
AGPL-3.0vs Firebase★ 2.4k
Instill Core
AI Infrastructure
🔮 Instill Core is a full-stack AI infrastructure tool for data, model and pipeline orches
OSSvs Unstructured★ 2.3k
Epsilla VectorDB
Databases
A high performance Vector Database leveraging parallel graph computing
GPL-3.0vs Pinecone★ 874
Supavec
AI Infrastructure
The open-source alternative to Carbon.ai. Build powerful RAG applications with any data so
Apache-2.0vs Vectara★ 1.2k
TPOT
AI Infrastructure
A Python Automated Machine Learning tool that optimizes machine learning pipelines using g
LGPL-3.0vs DataRobot★ 10k
InternVL
AI Infrastructure
[CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4
MITvs ChatGPT★ 10k
Superduper
AI Infrastructure
Superduper: End-to-end framework for building custom AI applications and agents.
Apache-2.0★ 5.3k
labml
AI Infrastructure
🔎 Monitor deep learning model training and hardware usage from your mobile phone 📱
MITvs Weights & Biases★ 2.3k
UpTrain
AI Infrastructure
UpTrain is an open-source unified platform to evaluate and improve Generative AI applicati
Apache-2.0vs Weights & Biases★ 2.4k
Hopsworks
AI Infrastructure
Hopsworks - Data-Intensive AI platform with a Feature Store
AGPL-3.0vs Amazon SageMaker★ 1.3k
MyScaleDB
Databases
A @ClickHouse fork that supports high-performance vector search and full-text search.
Apache-2.0vs Pinecone★ 1k
KubeDL
AI Infrastructure
Run your deep learning workloads on Kubernetes more easily and efficiently.
Apache-2.0vs Amazon SageMaker★ 534
AgentGov
AI Infrastructure
Open source platform for AI agent tracing and EU AI Act compliance with audit trails and risk documentation
SaaSAI Stats
AI Infrastructure
Database of AI models plus an OpenAI-compatible gateway with usage, pricing and reliability monitoring
SaaS
AICostTrack
AI Infrastructure
Tracks AI usage, token costs and profitability per customer for SaaS apps across supported AI providers
SaaS
AiSanity
AI Infrastructure
Quality layer for AI apps that monitors outputs for hallucinations
SaaS
AllToken
AI Infrastructure
Unified API gateway to LLMs from OpenAI, Anthropic and Google with usage tracking and routing
SaaS
Amazon Bedrock
AI Infrastructure
Managed AWS service for building generative AI apps with models from several providers
SaaS
Amazon SageMaker
AI Infrastructure
AWS platform for building, training and deploying machine learning models
SaaS
AnyRouter
AI Infrastructure
Unified LLM gateway that routes coding agents and MCP servers through a single endpoint
SaaS
Anyscale
AI Infrastructure
Managed platform for running Ray workloads for AI training and serving
SaaS