6,598 open-source and SaaS tools, with GitHub stats refreshed every day.

LangWatch

Open source

LangWatch is an open-source platform for tracing, evaluating and testing LLM applications and AI agents, with prompt management and an AI gateway.

Open-source alternative to

langwatch.ai
LangWatch homepage screenshot
GitHub stars
4.9k
Last commit
today
Repository age
3 years
Version
langwatch-3.20.1
Licence
Apache-2.0
Self-hosted
Yes

About LangWatch

LangWatch is an Apache-2.0 platform for running AI in production. It lets teams trace, test, route and govern LLM calls across the company, covering both the agents they build themselves and the coding assistants their engineers use. The project is aimed at AI engineers and platform teams that need visibility and control over model usage.

Its feature areas include LLM operations such as observability, agent testing, evaluations and prompt management, plus tracking of coding agent sessions with cost per pull request and per team and privacy controls. An AI gateway offers a single endpoint compatible with the OpenAI and Anthropic APIs, with virtual keys, budgets and routing, and an AI governance layer sits on top. Repository topics mention DSPy, datasets, simulation testing and low-code evaluation.

LangWatch is written in TypeScript and can be used through LangWatch Cloud or self-hosted; the README says only Node.js is required to try it locally, with separate guidance for production deployments. It suits teams moving LLM prototypes into monitored, tested production systems.

Key features

  • LLM observability and tracing
  • Agent testing and simulation
  • Evaluations over datasets
  • Managing and testing prompts
  • AI gateway with virtual keys and budgets
  • Coding agent cost tracking per team

Good fit for

  • →Testing AI agents before release
  • →Monitoring LLM cost and quality
  • →Governing company-wide AI usage
Built with
TypeScript
Tags
llm-observability
agent-testing
evaluations
llmops
prompt-management
ai-gateway
self-hosted
typescript

Open-source alternatives to LangWatch

See all

SaaS alternatives to LangWatch

See all