6 open-source alternatives ranked by real activity

Open-source Fiddler AI alternatives

A curated, ranked list of the 6 best open-source alternatives to Fiddler AI.

The best open-source alternative to Fiddler AI is Langfuse. If that doesn't suit you, other good options are Opik, Arize Phoenix, MLflow and Kubeflow.

Commercial alternatives to Fiddler AI include Arize AI, Galileo, AgentGov and AiSanity. See all 11.

Fiddler AI alternatives are mainly AI infrastructure tools, but some are also AI tools. 4 of them shipped code in the last 30 days, 6 can be self-hosted, and 4 use a permissive licence.

Last updated November 12, 2026 · ranked by GitHub stars, growth and recent commits

Langfuse

An open-source LLM engineering platform for tracing, evaluating and improving AI applications, with prompt management, datasets and a playground, self-hosted or cloud.

GitHub stars
37k
Last commit
today
Latest release
v4.79.0
Self-hosted
Yes
Hosted version
Available
langfuse.comLangfuse homepage screenshot

Langfuse is an open-source LLM engineering platform that helps teams develop, monitor, evaluate and debug AI applications together. You instrument your app, and Langfuse records traces of LLM calls and surrounding logic such as retrieval, embeddings and agent actions, so complex runs and user sessions can be inspected and debugged.

Prompt management lets you centrally version and iterate on prompts, with caching on server and client so that changes do not add latency to your app. Evaluation features cover LLM-as-a-judge, code evaluators, user feedback, manual labeling and custom pipelines through the API and SDKs. Datasets provide test sets and benchmarks, there is an LLM playground for trying prompts, and integrations exist for OpenAI, LangChain and LlamaIndex. It is built on the ClickHouse database, and the Langfuse team has been part of ClickHouse since January 2026.

You can use Langfuse Cloud or self-host it, which the maintainers say takes minutes. The repository license is listed as 'Other' because it combines open-source and enterprise components, so check the terms. It suits teams shipping production LLM features who need visibility into quality, latency and cost.

Key features

  • Tracing of LLM calls, retrieval and agent actions
  • Prompt versioning with caching
  • LLM-as-a-judge and custom evaluations
  • Datasets for tests and benchmarks
  • Interactive LLM playground
  • Integrations with OpenAI, LangChain and LlamaIndex

Pricing: Core has a $29 monthly base that includes 100k units, then $8 per 100k units with volume discounts. Hobby and Pro tiers exist but their prices are not shown in the text; Enterprise is by sales.

Read more about LangfuseWebsiteGitHub#1 Fiddler AI alternative

Opik

Opik is an open-source platform from Comet for tracing, evaluating and monitoring LLM applications, RAG systems and AI agents.

GitHub stars
23k
Last commit
yesterday
Latest release
2.2.143
Licence
Apache-2.0
Self-hosted
Yes
Hosted version
Available
comet.comOpik homepage screenshot

Opik is an open-source LLM observability and evaluation platform built by Comet. It covers the application lifecycle starting with early traces during development and ending with production monitoring, for teams that build LLM apps and AI agents. The code is Python, licensed under Apache-2.0, and the README says the full platform is free to self-host. The project documentation lives on the Comet site.

Capabilities include deep tracing of LLM calls and agent activity including complete trace trees for agents with several steps and tool calls, and evaluation with datasets, experiments and LLM-as-a-judge metrics for tasks like hallucination detection, moderation and RAG assessment. An Agent Optimizer SDK improves prompts and agents, dashboards and online evaluation rules support production monitoring, guardrails help with safe AI practices, and a PyTest integration tests LLM pipelines on each commit. Integrations include frameworks such as LangChain, LlamaIndex and OpenAI clients.

Key features

  • Tracing for LLM calls and agent steps
  • Datasets and experiments for evaluation
  • Evaluation metrics using LLM-as-a-judge
  • Prompt and agent optimization SDK
  • Production dashboards and online evaluation
  • PyTest integration for CI checks

Pricing: Free to self-host, with a free hosted tier of 25k spans. Pro includes 100k spans with extra spans at $5 per 100k; Enterprise is custom.

Read more about OpikWebsiteGitHub#2 Fiddler AI alternative

Arize Phoenix

Arize Phoenix is an open-source AI observability platform for tracing, evaluating and experimenting with LLM applications.

GitHub stars
12k
Last commit
yesterday
Latest release
@arizeai/phoenix-cli@1.22.0
Self-hosted
Yes
Hosted version
Available

Phoenix is built for experimentation, evaluation and troubleshooting of LLM apps. It traces an application's runtime using OpenTelemetry-based instrumentation, runs LLM-based evaluations of responses and retrieval, and keeps versioned datasets and experiments for comparing changes to prompts, models and retrieval.

Beyond tracing, it has a playground for comparing models and replaying traced calls, prompt management with version control and tagging, PXI, an agent built in for debugging traces, and a remote MCP server so tools such as Claude Code and Cursor can query traces, datasets and experiments. It is vendor and language agnostic, with support for frameworks like LangGraph, CrewAI, LlamaIndex and DSPy and providers such as OpenAI, Anthropic and AWS Bedrock.

Phoenix is open source and self-hosted. Install with pip install arize-phoenix and phoenix serve, run it with uvx, or deploy container images on Docker or Kubernetes through the Helm chart. For a managed platform, Arize sells Arize AX, and the same OpenTelemetry and OpenInference instrumentation works with both.

Key features

  • OpenTelemetry-based tracing of LLM applications
  • LLM-powered evaluation of responses and retrieval
  • Versioned datasets for experiments and fine-tuning
  • Prompt playground with model comparison and trace replay
  • Prompt management with version control and tagging
  • Remote MCP server for coding agents
  • Setup command detects framework and wires up trace export

MLflow

MLflow is an open-source platform for debugging, evaluating and monitoring AI agents, LLM applications and machine learning models.

GitHub stars
29k
Last commit
yesterday
Latest release
v3.18.0
Licence
Apache-2.0
Self-hosted
Yes
Hosted version
Available
mlflow.orgMLflow homepage screenshot

MLflow is an open-source AI engineering platform for agents, LLM applications and ML models. It helps teams debug, evaluate, monitor and optimize AI applications in production while keeping control of costs and access to models and data. It is written in Python, released under the Apache-2.0 license, and has been developed since 2018, with topics covering MLOps, model management and LLMOps.

For LLM and agent work it offers production observability with traces, plus evaluation, prompt management and prompt optimization, and an AI Gateway that governs costs and model access. It works with Python, TypeScript and JavaScript, Java and other languages, and integrates with OpenTelemetry and MCP. Getting started means starting an MLflow server, enabling logging in your code and running it, then exploring traces and metrics in the web UI on port 5000. A setup wizard can connect to an MLflow server or a Databricks workspace and add tracing with a coding agent.

Key features

  • Tracing and observability for LLM apps and agents
  • Evaluation tools for models and agents
  • Prompt management and prompt optimization
  • AI Gateway for cost and model access control
  • OpenTelemetry and MCP integration
  • Web UI for exploring traces and metrics

Pricing: Free and open source under the Apache-2.0 license; the README also mentions connecting to a Databricks workspace.

Read more about MLflowWebsiteGitHub#4 Fiddler AI alternative

Kubeflow

Kubeflow is an open source platform for deploying ML workflows on Kubernetes.

GitHub stars
16k
Last commit
1 mo ago
Latest release
redirect
Licence
Apache-2.0
Self-hosted
Yes
kubeflow.orgKubeflow homepage screenshot

Kubeflow is the Cloud Native AI platform composed of modular, open source projects that form a Kubernetes-native stack for data and AI workloads. It is designed for AI practitioners, platform administrators, and decision-makers who need modular, scalable, and extensible tools for data, AI/ML, and HPC use-cases.

The platform's mission is to bridge the Data, AI, and Cloud Native ecosystems, enabling teams to deliver more models, agents, and AI applications into production across the AI lifecycle. It is built by an open global community and aims to be the standard for Data & AI workloads on Kubernetes.

Key features

  • Runs workloads at any scale without requiring Kubernetes expertise
  • Portable across local laptops, on-premises, and any cloud
  • Manages hyperscale training jobs and high-throughput AI agents
  • Composable tools that can be mixed and matched across the AI lifecycle
  • Includes subprojects: Spark Operator, Notebooks, Trainer, Katib, and Hub
Read more about KubeflowWebsiteGitHub#5 Fiddler AI alternative

Lime

Open-source text editor written in Go, aiming for API compatibility with Sublime Text plugins through a pluggable backend and several frontends.

GitHub stars
15k
Last commit
5 yr ago
Licence
BSD-2-Clause
limetext.github.ioLime homepage screenshot

Lime is a text editor project that aims to be a free, open-source successor to Sublime Text. It is developed primarily in Go and released under the BSD 2-Clause licence. The project's meta repository points to a separate backend and three frontends in development: QML, a terminal interface based on termbox, and HTML.

Its central idea is API compatibility. The authors note that Sublime Text has a good plugin architecture and a large collection of plugins, and want people to use those extensions without developers needing to support more than one API. The homepage adds that you can develop your own frontend on the pluggable backend and use it as a drop-in replacement.

The founder's quoted motivation is dissatisfaction with how closed and slow Sublime Text's development felt, and not finding another editor he liked as much. The project is open to contributors, with a wiki covering goals, building and contributing.

Key features

  • API-compatible with Sublime Text plugins
  • Pluggable backend with several frontends
  • Custom frontends can be built on the backend
  • Primarily developed in Go
  • Three frontends in development: QML, termbox and HTML
Read more about LimeWebsiteGitHub#6 Fiddler AI alternative

Commercial Fiddler AI alternatives

Hosted, closed-source products that compete with Fiddler AI.

Fiddler AI alternatives: questions

What is the best open-source alternative to Fiddler AI?
Langfuse is the top-ranked open-source alternative to Fiddler AI on Enlisted: An open-source LLM engineering platform for tracing, evaluating and improving AI applications, with prompt management, datasets and a playground, self-hosted or cloud. Other strong options are Opik, Arize Phoenix, MLflow and Kubeflow.
What are the best commercial alternatives to Fiddler AI?
Arize AI, Galileo, AgentGov, AiSanity and Comet are among the hosted, closed-source alternatives to Fiddler AI listed on Enlisted, which lists 11 in total. Compare their pricing and features on each tool page.
Are these Fiddler AI alternatives free?
All 6 are open source, so the code is free to use under its licence, and all of them can be self-hosted on your own server or computer. 4 also offer a paid or managed cloud version if you'd rather not host it yourself.
How is this list of Fiddler AI alternatives ranked?
By a score built from GitHub stars, star growth over the last 30 days and how recently the code changed. 4 of these projects shipped code in the last 30 days. Data is refreshed daily, and nobody can pay to move up.

People also look for alternatives to…

View all