No direct Edge Impulse replacements listed yet
Open-source AI infrastructure tools. To compare with Edge Impulse.
60 open-source AI infrastructure tools
Ollama
AI Infrastructure
Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other model
MITvs ChatGPT★ 182k
Dify
AI Infrastructure
Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collabo
OSSvs Gumloop★ 158k
Langflow
AI Infrastructure
Langflow is a powerful tool for building and deploying AI-powered agents and workflows.
MITvs Gumloop★ 155k
llama.cpp
AI Infrastructure
LLM inference in C/C++
MITvs OpenAI API Platform★ 130k
vLLM
AI Infrastructure
A high-throughput and memory-efficient inference and serving engine for LLMs
Apache-2.0vs Amazon Bedrock★ 93k
RAGFlow
AI Infrastructure
RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cu
Apache-2.0vs Vectara★ 92k
Unsloth
AI Infrastructure
Unsloth is an open-source framework for running and training LLMs.
Apache-2.0vs Together AI★ 77k
LiteLLM
AI Infrastructure
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (o
OSSvs Amazon Bedrock★ 60k
PrivateGPT
AI Infrastructure
Complete API layer for private AI applications on local models: RAG, skills, tools, MCP, t
Apache-2.0vs ChatGPT★ 58k
whisper.cpp
AI Infrastructure
Port of OpenAI's Whisper model in C/C++
MITvs Deepgram★ 54k
LocalAI
AI Infrastructure
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video -
MITvs ChatGPT★ 49k
New API
AI Infrastructure
A unified AI model hub for aggregation & distribution. It supports cross-converting variou
AGPL-3.0vs OpenRouter★ 49k
exo
AI Infrastructure
Run frontier AI locally.
Apache-2.0★ 48k
Whisper
AI Infrastructure
Robust Speech Recognition via Large-Scale Weak Supervision
MITvs Deepgram★ 110k
SGLang
AI Infrastructure
SGLang is a high-performance serving framework for large language models and multimodal mo
Apache-2.0vs Amazon Bedrock★ 37k
Langfuse
AI Infrastructure
Trace, evaluate, and improve AI agents with one open platform. Use production data to unde
OSSvs Weights & Biases★ 35k
Qdrant
Databases
Qdrant - High-performance, massive-scale Vector Database and Vector Search Engine for the
Apache-2.0vs Pinecone★ 35k
WeKnora
AI Infrastructure
Open-source LLM knowledge platform: turn raw documents into a queryable RAG, an autonomous
OSS★ 32k
Chroma
Databases
Search infrastructure for AI
Apache-2.0vs Pinecone★ 29k
Sim
AI Infrastructure
Sim is the collaborative workspace to build, deploy, and monitor AI agents and workflows.
Apache-2.0vs Gumloop★ 30k
Label Studio
AI Infrastructure
Label Studio is a multi-type data labeling and annotation tool with standardized output fo
Apache-2.0vs Roboflow★ 28k
MLflow
AI Infrastructure
The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables te
Apache-2.0vs Weights & Biases★ 28k
llamafile
AI Infrastructure
Distribute and run LLMs with a single file.
OSSvs ChatGPT★ 26k
Promptfoo
AI Infrastructure
Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI.
MITvs Braintrust★ 26k
MLC LLM
AI Infrastructure
Universal LLM Deployment Engine with ML Compilation
Apache-2.0★ 23k
Opik
AI Infrastructure
Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows wit
Apache-2.0vs Weights & Biases★ 22k
CVAT
AI Infrastructure
Computer Vision Annotation Tool (CVAT) is a leading platform for building high-quality vis
MITvs Roboflow★ 17k
Weaviate
Databases
Weaviate is an open-source vector database that stores both objects and vectors, allowing
OSSvs Pinecone★ 17k
MCP Toolbox
AI Infrastructure
MCP Toolbox for Databases is an open source MCP server for databases.
Apache-2.0vs Connect★ 17k
Trigger.dev
Workflow Automation
Trigger.dev – build and deploy durable AI agents and workflows
Apache-2.0★ 16k
RD-Agent
AI Infrastructure
Research and development (R&D) is crucial for the enhancement of industrial productivity,
MIT★ 15k
Arize Phoenix
AI Infrastructure
AI Observability & Evaluation
OSSvs Weights & Biases★ 12k
LanceDB
Databases
Developer-friendly OSS embedded retrieval library for multimodal AI. Search More; Manage L
Apache-2.0vs Pinecone★ 12k
Astron Agent
AI Infrastructure
Enterprise-grade, commercial-friendly agentic workflow platform for building next-generati
Apache-2.0★ 8.9k
Microsandbox
AI Infrastructure
Easy, fast microVMs for untrusted workloads
Apache-2.0★ 8.5k
Rasa
AI Infrastructure
💬 Open source machine learning framework to automate text- and voice-based conversation
Apache-2.0vs Voiceflow★ 21k
Yuxi
AI Infrastructure
可私有部署的多租户知识智能体平台，统一知识库、知识图谱、多智能体执行、MCP/Skills、沙盒与权限管理。
MIT★ 7.3kGPT-Load
AI Infrastructure
Self-hosted AI gateway for scheduling API keys and subscription accounts across 35 channel
MIT★ 7k
Vespa
Search
The AI search platform
Apache-2.0vs Elastic★ 7.1k
ODS
AI Infrastructure
Just a chat full of self-hosters running or trying to run ODS. | 1583 members
Apache-2.0★ 7k
RWKV-Runner
AI Infrastructure
A RWKV management and startup tool, full automation, only 8MB. And provides an interface c
MIT★ 6.5k
Helicone
AI Infrastructure
🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and expe
Apache-2.0vs OpenRouter★ 6.2k
HelixDB
Databases
HelixDB is an OLTP graph database with native vector and full-text search built in Rust on
Apache-2.0vs Amazon Neptune★ 6.1k
One API
AI Infrastructure
LLM API 管理 & 分发系统，支持 OpenAI、Azure、Anthropic Claude、Google Gemini、DeepSeek、字节豆包、ChatGLM、文心一
MITvs OpenRouter★ 37k
OpenConnector
AI Infrastructure
Open-source auth gateway connecting 1500+ SaaS providers to AI agents through SDK, CLI, MC
Apache-2.0★ 5.9k
Wigolo
Search
The go-to web for your AI coding agent — local-first search, fetch, crawl & research over
OSSvs Tavily★ 5.4k
Olares
Infrastructure & Containers
Open-Source Personal Cloud OS for Always-On Agents
AGPL-3.0★ 5.3k
LangWatch
AI Infrastructure
The platform for LLM evaluations and AI agent testing
Apache-2.0vs LangSmith★ 4.9k
Infinity
Databases
The AI-native database built for LLM applications, providing incredibly fast hybrid search
Apache-2.0vs Pinecone★ 4.7k
Observal
AI Infrastructure
Observal is self-hosted registry for your coding agent extensions with a built in insight
Apache-2.0★ 4k
Laminar
AI Infrastructure
Laminar - open-source observability platform purpose-built for AI agents. YC S24.
Apache-2.0vs Weights & Biases★ 3.3kHarbor
AI Infrastructure
Stop configuring your AI stack. Start using it. One command brings a complete pre-wired LL
Apache-2.0★ 3.2k
OpenPAI
AI Infrastructure
Resource scheduling and cluster management for AI
MITvs Azure Machine Learning★ 2.7k
Portkey AI Gateway
AI Infrastructure
A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardra
MITvs Amazon Bedrock★ 13k
beta9
AI Infrastructure
Ultrafast serverless GPU inference, sandboxes, and background jobs
AGPL-3.0vs Modal★ 1.8k
Anakin
Workflow Automation
Open-source web scraping API. Turn any website into clean markdown or structured JSON. Ant
AGPL-3.0vs Apify★ 4.5k
Docs MCP Server
Developer Tools
Grounded Docs MCP Server: Open-Source Alternative to Context7, Nia, and Ref.Tools
MIT★ 1.8k
LLM Gateway
AI Infrastructure
Route, manage, and analyze your LLM requests across multiple providers with a unified API
OSSvs Amazon Bedrock★ 1.7k
Paddler
AI Infrastructure
Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at
Apache-2.0★ 1.7k
Ktx
AI Infrastructure
ktx is an executable context layer for data and analytics agents 🐙 Allow Claude Code, Cod
Apache-2.0★ 1.6k
See every AI infrastructure tool or the Edge Impulse listing.