7,363 open-source and SaaS tools, with GitHub stats refreshed every day.

Galileo

SaaS

AI observability and evaluation platform that turns offline evals into production guardrails for RAG pipelines, agents and generative AI applications.

galileo.ai
Galileo homepage screenshot

About Galileo

Galileo is an AI observability and eval engineering platform. Its pitch is not only to monitor AI failures but to stop them, by turning the evaluations teams run during development into guardrails that operate on live traffic.

The workflow starts with building datasets from synthetic, development and production data and capturing expert annotations. Metrics are tuned automatically from live feedback, and the platform includes a set of prebuilt evaluators for RAG, agents, safety and security alongside custom ones. Expensive LLM-as-judge evaluators can be distilled into compact Luna models for faster, cheaper monitoring, and an insights engine analyzes agent behavior to identify failure modes and suggest fixes.

Galileo is a proprietary commercial service with a free start option, a demo and a published pricing page. It suits enterprise and developer teams who need systematic quality control for AI applications.

Key features

  • Datasets from synthetic and production data
  • Prebuilt evals for RAG, agents and safety
  • Custom evaluators with auto-tuned metrics
  • Luna models for low-cost monitoring
  • Insights engine for failure analysis
  • Production guardrails from offline evals

Good fit for

  • →Evaluating RAG pipelines before launch
  • →Monitoring agent failures in production
  • →Applying safety guardrails to live traffic
Tags
llm-evaluation
llm-observability
guardrails
rag
agents
evals
llmops
ai-infrastructure

Galileo: questions and answers

What is Galileo used for?
Galileo is an AI observability and evaluation platform that turns offline evals into production guardrails for RAG pipelines, agents and generative AI applications. It is a good fit for evaluating RAG pipelines before launch, monitoring agent failures in production and applying safety guardrails to live traffic.
Is Galileo free?
Yes. Galileo has a free plan, and paid plans start at $100 per month.
Is Galileo open source?
No. Galileo is proprietary (closed-source) software. Open-source alternatives to Galileo include Opik, Arize Phoenix and LangWatch.
What are some alternatives to Galileo?
Galileo competes with Arize AI, Braintrust and LangSmith. For open-source options, see Enlisted's ranked list of open-source Galileo alternatives.

Open-source alternatives to Galileo

See all

SaaS alternatives to Galileo

See all