Open-source AI infrastructure tools. To compare with Apiframe.

Ollama

AI Infrastructure

Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other model

Dify

AI Infrastructure

Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collabo

Langflow

AI Infrastructure

Langflow is a powerful tool for building and deploying AI-powered agents and workflows.

llama.cpp

AI Infrastructure

LLM inference in C/C++

vLLM

AI Infrastructure

A high-throughput and memory-efficient inference and serving engine for LLMs

RAGFlow

AI Infrastructure

RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cu

Unsloth

AI Infrastructure

Unsloth is an open-source framework for running and training LLMs.

LiteLLM

AI Infrastructure

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (o

PrivateGPT

AI Infrastructure

Complete API layer for private AI applications on local models: RAG, skills, tools, MCP, t

whisper.cpp

AI Infrastructure

Port of OpenAI's Whisper model in C/C++

LocalAI

AI Infrastructure

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video -

New API

AI Infrastructure

A unified AI model hub for aggregation & distribution. It supports cross-converting variou

exo

AI Infrastructure

Run frontier AI locally.

Whisper

AI Infrastructure

Robust Speech Recognition via Large-Scale Weak Supervision

SGLang

AI Infrastructure

SGLang is a high-performance serving framework for large language models and multimodal mo

Langfuse

AI Infrastructure

Trace, evaluate, and improve AI agents with one open platform. Use production data to unde

Qdrant

Databases

Qdrant - High-performance, massive-scale Vector Database and Vector Search Engine for the

WeKnora

AI Infrastructure

Open-source LLM knowledge platform: turn raw documents into a queryable RAG, an autonomous

Chroma

Databases

Search infrastructure for AI

Sim

AI Infrastructure

Sim is the collaborative workspace to build, deploy, and monitor AI agents and workflows.

Label Studio

AI Infrastructure

Label Studio is a multi-type data labeling and annotation tool with standardized output fo

MLflow

AI Infrastructure

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables te

llamafile

AI Infrastructure

Distribute and run LLMs with a single file.

Promptfoo

AI Infrastructure

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI.

MLC LLM

AI Infrastructure

Universal LLM Deployment Engine with ML Compilation

Opik

AI Infrastructure

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows wit

CVAT

AI Infrastructure

Computer Vision Annotation Tool (CVAT) is a leading platform for building high-quality vis

Weaviate

Databases

Weaviate is an open-source vector database that stores both objects and vectors, allowing

MCP Toolbox

AI Infrastructure

MCP Toolbox for Databases is an open source MCP server for databases.

Trigger.dev

Workflow Automation

Trigger.dev – build and deploy durable AI agents and workflows

RD-Agent

AI Infrastructure

Research and development (R&D) is crucial for the enhancement of industrial productivity,

Arize Phoenix

AI Infrastructure

AI Observability & Evaluation

LanceDB

Databases

Developer-friendly OSS embedded retrieval library for multimodal AI. Search More; Manage L

Astron Agent

AI Infrastructure

Enterprise-grade, commercial-friendly agentic workflow platform for building next-generati

Microsandbox

AI Infrastructure

Easy, fast microVMs for untrusted workloads

Rasa

AI Infrastructure

💬 Open source machine learning framework to automate text- and voice-based conversation

Yuxi

AI Infrastructure

可私有部署的多租户知识智能体平台，统一知识库、知识图谱、多智能体执行、MCP/Skills、沙盒与权限管理。

Self-hosted AI gateway for scheduling API keys and subscription accounts across 35 channel

Vespa

Search

The AI search platform

ODS

AI Infrastructure

Just a chat full of self-hosters running or trying to run ODS. | 1583 members

RWKV-Runner

AI Infrastructure

A RWKV management and startup tool, full automation, only 8MB. And provides an interface c

Helicone

AI Infrastructure

🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and expe

HelixDB

Databases

HelixDB is an OLTP graph database with native vector and full-text search built in Rust on

One API

AI Infrastructure

LLM API 管理 & 分发系统，支持 OpenAI、Azure、Anthropic Claude、Google Gemini、DeepSeek、字节豆包、ChatGLM、文心一

OpenConnector

AI Infrastructure

Open-source auth gateway connecting 1500+ SaaS providers to AI agents through SDK, CLI, MC

Wigolo

Search

The go-to web for your AI coding agent — local-first search, fetch, crawl & research over

Olares

Infrastructure & Containers

Open-Source Personal Cloud OS for Always-On Agents

LangWatch

AI Infrastructure

The platform for LLM evaluations and AI agent testing

Infinity

Databases

The AI-native database built for LLM applications, providing incredibly fast hybrid search

Observal

AI Infrastructure

Observal is self-hosted registry for your coding agent extensions with a built in insight

Laminar

AI Infrastructure

Laminar - open-source observability platform purpose-built for AI agents. YC S24.

Stop configuring your AI stack. Start using it. One command brings a complete pre-wired LL

OpenPAI

AI Infrastructure

Resource scheduling and cluster management for AI

Portkey AI Gateway

AI Infrastructure

A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardra

beta9

AI Infrastructure

Ultrafast serverless GPU inference, sandboxes, and background jobs

Anakin

Workflow Automation

Open-source web scraping API. Turn any website into clean markdown or structured JSON. Ant

Docs MCP Server

Developer Tools

Grounded Docs MCP Server: Open-Source Alternative to Context7, Nia, and Ref.Tools

LLM Gateway

AI Infrastructure

Route, manage, and analyze your LLM requests across multiple providers with a unified API

Paddler

AI Infrastructure

Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at

Ktx

AI Infrastructure

ktx is an executable context layer for data and analytics agents 🐙 Allow Claude Code, Cod