9 open-source alternatives ranked by real activity

Open-source Cohere alternatives

A curated, ranked list of the 9 best open-source alternatives to Cohere.

The best open-source alternative to Cohere is Ollama. If that doesn't suit you, other good options are vLLM, RAGFlow, LocalAI and LlamaIndex.

Commercial alternatives to Cohere include OpenAI API Platform, Mistral AI, Voyage AI and DeepSeek. See all 26.

Cohere alternatives are mainly AI infrastructure tools, but some are also databases and AI tools. 9 of them shipped code in the last 30 days, 9 can be self-hosted, and 8 use a permissive licence.

Last updated November 12, 2026 · ranked by GitHub stars, growth and recent commits

Ollama

A tool for downloading and running open large language models locally through a command line and REST API, with Docker support and many integrations.

GitHub stars
187k
Last commit
yesterday
Latest release
v0.40.16
Licence
MIT
Self-hosted
Yes
ollama.comOllama homepage screenshot

Ollama makes it straightforward to run open large language models on your own machine. You install it on macOS, Windows or Linux, or use the official Docker image, then pull a model and chat with it from the command line. It is written in Go and released under the MIT license, and it builds on the llama.cpp project for inference.

Besides the CLI, Ollama provides a REST API for managing and running models, with official Python and JavaScript client libraries. Models can be imported and customized through a Modelfile, and an online library lists what is available. It can be connected to coding agents and assistants such as Claude Code, OpenCode, Codex and OpenClaw, and many community chat interfaces, including Open WebUI and LibreChat, work with it.

Because models run on your own hardware, Ollama can serve as a self-hosted alternative to cloud assistants such as ChatGPT and Perplexity when privacy, offline use or cost control matter. It is aimed at developers and hobbyists experimenting with open models, and at teams that want to wire local models into their own applications.

Key features

  • Run open language models locally from the CLI
  • REST API for managing and running models
  • Official Python and JavaScript libraries
  • Modelfile for customizing and importing models
  • Official Docker image
  • Integrations with coding agents and chat interfaces

Pricing: Running models locally is free, and the Free plan includes starter cloud credits. Pro costs $20, Max $100 and Team $500 per month with included usage credits; Enterprise is custom.

vLLM

A Python library and server for fast, memory-efficient LLM inference and serving, with PagedAttention, continuous batching and broad quantization support.

GitHub stars
97k
Last commit
yesterday
Latest release
v0.33.0rc3
Licence
Apache-2.0
Self-hosted
Yes
vllm.aivLLM homepage screenshot

vLLM is an open-source library for running and serving large language models efficiently. It originated at UC Berkeley's Sky Computing Lab and is now developed by a large community of contributors from academia and industry. It is written in Python and released under the Apache-2.0 license.

Speed comes from techniques such as PagedAttention for attention key-value memory, batching incoming requests continuously, chunked prefill, prefix caching, CUDA and HIP graphs, and optimized attention and mixture-of-experts kernels. It supports many quantization formats, including FP8, INT8, INT4, GPTQ and AWQ, as well as speculative decoding and disaggregated prefill and decode.

On the usability side, vLLM integrates with Hugging Face models and supports parallel sampling, beam search, streaming outputs, structured outputs and tool calling, plus several parallelism modes (tensor, pipeline, data, expert and context) for distributed inference. It targets NVIDIA, AMD and TPU hardware and suits teams that serve open models in production and need high throughput.

Key features

  • PagedAttention and continuous batching
  • Quantization including FP8, INT8, GPTQ and AWQ
  • Speculative decoding support
  • Tensor, pipeline and expert parallelism
  • OpenAI-compatible API server
  • Hugging Face model integration
  • Streaming and structured outputs

Pricing: Free and open source under the Apache-2.0 license.

RAGFlow

An open-source retrieval-augmented generation engine that combines document understanding with agent capabilities to give LLMs grounded context.

GitHub stars
94k
Last commit
yesterday
Latest release
v1.0.0
Licence
Apache-2.0
Self-hosted
Yes
Hosted version
Available
ragflow.ioRAGFlow homepage screenshot

RAGFlow is an open-source engine for retrieval-augmented generation (RAG). It combines RAG with agent capabilities to give large language models a context layer built from your own documents, so applications can answer from real data. It is released under the Apache-2.0 license and, per the repository, is currently at a 1.0.0 release candidate.

It extracts knowledge from unstructured documents with complicated formats using deep document understanding, and offers pre-built agent templates. Recent updates mentioned in the README include website ingestion through sitemaps, Google BigQuery data sources with incremental sync, knowledge compilation that generates wikis, graphs, trees and mind maps, and agentic RAG with multiple thinking modes.

You can try the managed cloud service or deploy it locally by following the local deployment guide. The project provides documentation, a roadmap and a Discord community. It suits developers and enterprises building document question answering and knowledge-based assistants who want control over their data pipeline.

Key features

  • Deep document understanding for unstructured files
  • Retrieval-augmented generation workflows
  • Pre-built agent templates
  • Agentic RAG with adjustable thinking modes
  • Website ingestion through sitemaps
  • Knowledge compilation into wikis and graphs
  • Google BigQuery data source sync

Pricing: Free plan with 500 credits per month. Starter shows $59 and Pro $259 per month (a lower unlabeled price of $29 and $129 likely applies with annual billing); Enterprise is quoted and can be deployed on-premises.

LocalAI

An open-source AI engine that runs LLMs, vision, voice, image and video models on your own hardware behind OpenAI-compatible APIs, with no GPU required.

GitHub stars
50k
Last commit
yesterday
Latest release
v4.12.1
Licence
MIT
Self-hosted
Yes
localai.ioLocalAI homepage screenshot

LocalAI is an open-source AI engine for running models of many kinds, including language, vision, voice, image and video models, on your own hardware. A GPU is not required. It is written in Go and released under the MIT license, was started by Ettore Di Giacinto and is looked after by the LocalAI team.

Its design is a small core with separate backends that are pulled on demand, so nothing unused gets installed. Backends wrap engines such as llama.cpp, vLLM, whisper.cpp, stable-diffusion and MLX, and you can write your own in any language against an open interface. It can run on CPU alone, through Vulkan, or on NVIDIA, AMD, Intel and Apple Silicon hardware.

APIs are drop-in compatible with OpenAI, Anthropic and ElevenLabs across every backend. Multi-user features include API key authentication, user quotas and role-based access, and built-in agents support tool use, RAG, MCP and skills. The project stresses that data stays on your infrastructure. It suits developers and teams who want a private, self-hosted replacement for cloud AI APIs.

Key features

  • Runs LLM, vision, voice, image and video models
  • Composable backends pulled on demand
  • OpenAI, Anthropic and ElevenLabs API compatibility
  • Runs on CPU, NVIDIA, AMD, Intel and Apple Silicon
  • API key authentication, quotas and role-based access
  • Built-in agents with tools, RAG and MCP

Pricing: Free and open source under the MIT license.

LlamaIndex

LlamaParse is a document processing platform that converts PDFs, scans, and Office files to markdown or JSON, and extracts structured data.

GitHub stars
53k
Last commit
2 days ago
Latest release
v0.14.25
Licence
MIT
Hosted version
Available
developers.llamaindex.aiLlamaIndex homepage screenshot

LlamaParse is a document processing platform from LlamaIndex. It provides APIs to parse PDFs, scans, and Office files into markdown or JSON, and to extract structured data in a user-defined schema. The platform also includes features for classifying, segmenting, and indexing documents.

It offers SDKs for Python, TypeScript, Go, and Java, and can be accessed via a single API key. The platform includes a web UI for extraction and supports batch processing, polling, and latency management for production use.

Key features

  • Parse converts PDFs, scans, and Office files to markdown or JSON
  • Extract returns JSON in a user-defined schema
  • Classify, Split, and Index cover sorting, segmenting, and retrieval
  • SDKs for Python, TypeScript, Go, and Java
  • Web UI for extraction
  • Supports batch processing, polling, and latency management

Qdrant

A vector database and similarity search engine written in Rust, offering filtering over stored vectors and payloads, available self-hosted or as Qdrant Cloud.

GitHub stars
36k
Last commit
today
Latest release
v1.20.0
Licence
Apache-2.0
Self-hosted
Yes
Hosted version
Available
qdrant.techQdrant homepage screenshot

Qdrant is a vector database and similarity search engine. It stores points, which are vectors plus an attached payload, and exposes an API to store, search and manage them. That makes it a building block for semantic search, recommendations, image search and other applications that rely on embeddings from neural networks.

A key selling point is extended filtering support, so a vector query can be combined with conditions on the payload, which is useful for faceted search and matching. The engine is written in Rust and the maintainers point to benchmarks for its speed and reliability under load. Topics mention HNSW indexing and nearest-neighbor search, and there are client libraries, demo projects, integrations and a collection of agent skills that bring vector search into AI coding assistants.

Qdrant is Apache-2.0 licensed and can run on your own infrastructure. It is also available as the fully managed Qdrant Cloud, which includes a free tier. Teams building retrieval-augmented generation, recommendation and similarity features use it as the storage and retrieval layer for their embeddings.

Key features

  • Vector storage with attached payloads
  • Filtering combined with vector search
  • HNSW-based nearest-neighbor search
  • REST-style API with client libraries
  • Agent skills for AI coding assistants
  • Self-hosted or managed Qdrant Cloud

Pricing: A free-forever cloud tier is available. The Standard tier is usage-based, from $25; Premium requires a minimum spend and Hybrid and Private Cloud are quoted by the team.

Milvus

An open-source, cloud-native vector database for scalable similarity search over embeddings, with distributed, standalone and lightweight Python modes.

GitHub stars
47k
Last commit
yesterday
Latest release
v3.0.6
Licence
Apache-2.0
Self-hosted
Yes
Hosted version
Available
milvus.ioMilvus homepage screenshot

Milvus is an open-source vector database designed to scale. It supports AI applications by handling large volumes of unstructured data, including text, images and mixed-media content. It is written in Go and C++ with hardware acceleration for CPUs and GPUs, and it is released under the Apache-2.0 license.

The architecture is fully distributed and Kubernetes-native, so it can scale out horizontally while staying current through streaming updates in real time. Smaller deployments are covered too: a Standalone mode runs on a single machine, and Milvus Lite is a lightweight version installed with pip for quick starts in Python. The pymilvus SDK and its MilvusClient are used to create collections, ingest data and run vector searches.

Milvus can be self-hosted, or consumed as a managed service through Zilliz Cloud, which offers Serverless, Dedicated and bring-your-own-cloud options. The project is hosted by the LF AI & Data Foundation, with Zilliz as its major contributor. It suits teams building retrieval-augmented generation, semantic search and recommendation systems.

Key features

  • Vector similarity search over embeddings
  • Distributed, Kubernetes-native architecture
  • Standalone mode for single machines
  • Milvus Lite for quick Python starts
  • Real-time streaming updates
  • CPU and GPU hardware acceleration

Pricing: Open source under Apache 2.0; Zilliz Cloud offers a managed service with Serverless, Dedicated and BYOC options.

Weaviate

A cloud-native vector database that stores objects and embeddings and combines semantic search with keyword filtering, RAG and reranking in one query interface.

GitHub stars
17k
Last commit
yesterday
Latest release
v1.40.5
Self-hosted
Yes
Hosted version
Available
weaviate.ioWeaviate homepage screenshot

Weaviate is a vector database that stores both data objects and their vector embeddings, enabling semantic search at scale. One query interface can blend vector similarity search, keyword filtering, retrieval-augmented generation and reranking, and it is written in Go as a cloud-native system.

Common applications are RAG pipelines, semantic and image search, recommenders, chatbots and content classification. Vectors can be created automatically on import by integrated models from providers such as OpenAI, Cohere and Hugging Face, or you can import pre-computed embeddings. For production, it offers built-in multi-tenancy, replication and role-based access control. Topics reference approximate nearest neighbor search and HNSW indexing.

Weaviate can be deployed with Docker, on Kubernetes, or through the managed Weaviate Cloud, with guides for AWS and GCP, and the documentation includes quickstarts for both cloud and a local Docker instance. Its license is listed as 'Other' on GitHub, so check the repository terms. It suits teams building AI applications that need a scalable store for embeddings alongside structured filters.

Key features

  • Stores objects and vectors together
  • Hybrid vector and keyword search
  • Integrated vectorizer models or bring your own
  • Multi-tenancy and replication
  • Role-based access control
  • Docker, Kubernetes and Weaviate Cloud options

Hugging Face Chat UI

SvelteKit chat interface for large language models that connects to any OpenAI-compatible API and powers HuggingChat.

GitHub stars
11k
Last commit
yesterday
Latest release
v0.10.0
Licence
Apache-2.0
Self-hosted
Yes
Hosted version
Available
huggingface.coHugging Face Chat UI homepage screenshot

Chat UI is a chat interface for LLMs built as a SvelteKit application. It is the open source codebase behind HuggingChat on Hugging Face and lets you run a similar conversational front end against models you choose, whether hosted or running locally.

The current version speaks only to OpenAI-compatible APIs, configured through a base URL and a models endpoint. The README lists the Hugging Face Inference Providers router, a llama.cpp server, Ollama through its OpenAI-compatible bridge, OpenRouter and Poe as example backends. Older provider-specific integrations were removed from the main branch but remain available on a legacy branch.

Setup involves creating an .env.local file with the endpoint and key, choosing a database option, and launching the app, with an optional Docker image. The project is written in TypeScript with Tailwind CSS and is licensed under Apache-2.0, making it a base for self-hosted assistants.

Key features

  • Chat front end for any OpenAI-compatible API
  • Works with llama.cpp, Ollama and OpenRouter
  • Hugging Face Inference Providers support
  • Configured through a simple .env.local file
  • Optional Docker image
  • SvelteKit and Tailwind CSS codebase

Pricing: Free and open source under the Apache-2.0 license.

Commercial Cohere alternatives

Hosted, closed-source products that compete with Cohere. Showing 12 of 26.

See every Cohere alternative on its tool page

Cohere alternatives: questions

What is the best open-source alternative to Cohere?
Ollama is the top-ranked open-source alternative to Cohere on Enlisted: A tool for downloading and running open large language models locally through a command line and REST API, with Docker support and many integrations. Other strong options are vLLM, RAGFlow, LocalAI and LlamaIndex.
What are the best commercial alternatives to Cohere?
OpenAI API Platform, Mistral AI, Voyage AI, DeepSeek and xAI API are among the hosted, closed-source alternatives to Cohere listed on Enlisted, which lists 26 in total. Compare their pricing and features on each tool page.
Are these Cohere alternatives free?
All 9 are open source, so the code is free to use under its licence, and all of them can be self-hosted on your own server or computer. 6 also offer a paid or managed cloud version if you'd rather not host it yourself.
How is this list of Cohere alternatives ranked?
By a score built from GitHub stars, star growth over the last 30 days and how recently the code changed. 9 of these projects shipped code in the last 30 days. Data is refreshed daily, and nobody can pay to move up.

People also look for alternatives to…

View all