The best AI infrastructure tools. Page 2 of 4.

Infinity

Databases

The AI-native database built for LLM applications, providing incredibly fast hybrid search

Observal

AI Infrastructure

Observal is self-hosted registry for your coding agent extensions with a built in insight

Laminar

AI Infrastructure

Laminar - open-source observability platform purpose-built for AI agents. YC S24.

Stop configuring your AI stack. Start using it. One command brings a complete pre-wired LL

OpenPAI

AI Infrastructure

Resource scheduling and cluster management for AI

Portkey AI Gateway

AI Infrastructure

A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardra

beta9

AI Infrastructure

Ultrafast serverless GPU inference, sandboxes, and background jobs

Anakin

Workflow Automation

Open-source web scraping API. Turn any website into clean markdown or structured JSON. Ant

Docs MCP Server

Developer Tools

Grounded Docs MCP Server: Open-Source Alternative to Context7, Nia, and Ref.Tools

LLM Gateway

AI Infrastructure

Route, manage, and analyze your LLM requests across multiple providers with a unified API

Paddler

AI Infrastructure

Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at

Ktx

AI Infrastructure

ktx is an executable context layer for data and analytics agents 🐙 Allow Claude Code, Cod

CoAI

AI Infrastructure

🚀 Next Gen Multi-tenant AI One-Stop Solution. Builtin Admin & Billing System. Enterprise-

AppPlatform

AI Infrastructure

AppPlatform 是一个前沿的大模型应用工程，旨在通过集成的声明式编程和低代码配置工具，简化和优化大模型的训练与推理应用的开发过程。本工程为软件工程师和产品经理提供一个强大的

Inkeep Agents

AI Infrastructure

Create AI Agents in a No-Code Visual Builder or TypeScript SDK with full 2-way sync. For s

Pezzo

AI Infrastructure

🕹️ Open-source, developer-first LLMOps platform designed to streamline prompt design, ver

JamAI Base

AI Infrastructure

The collaborative spreadsheet for AI. Chain cells into powerful pipelines, experiment with

Obot

AI Infrastructure

Complete AI Governance Platform from Obot AI

TraceRoot

AI Infrastructure

TraceRoot - open source self improving layer for ai agents YC S25

Nndeploy

AI Infrastructure

一款简单易用和高性能的AI部署框架 | An Easy-to-Use and High-Performance AI Deployment Framework

AnythingMCP

AI Infrastructure

Open-source, self-hosted MCP gateway: turn any REST/OpenAPI, SOAP, GraphQL, OData or SQL A

Backend.AI

AI Infrastructure

Backend.AI is a streamlined, container-based computing cluster platform that hosts popular

Rome

AI Infrastructure

A compounding agent OS for recursive agents. Also an open source alternative to Grok Bot a

KiwiFS

AI Infrastructure

Markdown filesystem for agents and teams.

Trieve

Search

All-in-one platform for search, recommendations, RAG, and analytics offered via API

1Backend

Backend as a Service

Build AI (or any) apps with scalable microservices & microfrontends.

Instill Core

AI Infrastructure

🔮 Instill Core is a full-stack AI infrastructure tool for data, model and pipeline orches

Open Managed Agents

AI Infrastructure

Open Managed Agents — an open-source alternative to Claude Managed Agents and OpenAI Agent

Supavec

AI Infrastructure

The open-source alternative to Carbon.ai. Build powerful RAG applications with any data so

Epsilla VectorDB

Databases

A high performance Vector Database leveraging parallel graph computing

InternVL

AI Infrastructure

[CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4

TPOT

AI Infrastructure

A Python Automated Machine Learning tool that optimizes machine learning pipelines using g

Superduper

AI Infrastructure

Superduper: End-to-end framework for building custom AI applications and agents.

CML

CI/CD & DevOps

♾️ CML - Continuous Machine Learning | CI/CD for ML

labml

AI Infrastructure

🔎 Monitor deep learning model training and hardware usage from your mobile phone 📱

UpTrain

AI Infrastructure

UpTrain is an open-source unified platform to evaluate and improve Generative AI applicati

MyScaleDB

Databases

A @ClickHouse fork that supports high-performance vector search and full-text search.

KubeDL

AI Infrastructure

Run your deep learning workloads on Kubernetes more easily and efficiently.

AgentGov

AI Infrastructure

Open source platform for AI agent tracing and EU AI Act compliance with audit trails and risk documentation

Database of AI models plus an OpenAI-compatible gateway with usage, pricing and reliability monitoring

AiSanity

AI Infrastructure

Quality layer for AI apps that monitors outputs for hallucinations

AllToken

AI Infrastructure

Unified API gateway to LLMs from OpenAI, Anthropic and Google with usage tracking and routing

Amazon Bedrock

AI Infrastructure

Managed AWS service for building generative AI apps with models from several providers

Amazon SageMaker

AI Infrastructure

AWS platform for building, training and deploying machine learning models

AnyRouter

AI Infrastructure

Unified LLM gateway that routes coding agents and MCP servers through a single endpoint

Anyscale

AI Infrastructure

Managed platform for running Ray workloads for AI training and serving

api-hub.ai

AI Infrastructure

Single API for accessing many AI models behind one endpoint

Apiframe

AI Infrastructure

One API for AI image, video and music generation across multiple model providers