About LangWatch
LangWatch is an Apache-2.0 platform for running AI in production. It lets teams trace, test, route and govern LLM calls across the company, covering both the agents they build themselves and the coding assistants their engineers use. The project is aimed at AI engineers and platform teams that need visibility and control over model usage.
Its feature areas include LLM operations such as observability, agent testing, evaluations and prompt management, plus tracking of coding agent sessions with cost per pull request and per team and privacy controls. An AI gateway offers a single endpoint compatible with the OpenAI and Anthropic APIs, with virtual keys, budgets and routing, and an AI governance layer sits on top. Repository topics mention DSPy, datasets, simulation testing and low-code evaluation.
LangWatch is written in TypeScript and can be used through LangWatch Cloud or self-hosted; the README says only Node.js is required to try it locally, with separate guidance for production deployments. It suits teams moving LLM prototypes into monitored, tested production systems.
Key features
- LLM observability and tracing
- Agent testing and simulation
- Evaluations over datasets
- Managing and testing prompts
- AI gateway with virtual keys and budgets
- Coding agent cost tracking per team
Good fit for
- →Testing AI agents before release
- →Monitoring LLM cost and quality
- →Governing company-wide AI usage
- Built with
- TypeScript
- Tags
- llm-observability
- agent-testing
- evaluations
- llmops
- prompt-management
- ai-gateway
- self-hosted
- typescript
Open-source alternatives to LangWatch
See all
Langfuse
AI Infrastructure
Trace, evaluate, and improve AI agents with one open platform. Use production data to unde
OSSvs Weights & Biases★ 35k
Opik
AI Infrastructure
Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows wit
Apache-2.0vs Weights & Biases★ 22k
Arize Phoenix
AI Infrastructure
AI Observability & Evaluation
OSSvs Weights & Biases★ 12k
Laminar
AI Infrastructure
Laminar - open-source observability platform purpose-built for AI agents. YC S24.
Apache-2.0vs Weights & Biases★ 3.3k
TraceRoot
AI Infrastructure
TraceRoot - open source self improving layer for ai agents YC S25
OSSvs Weights & Biases★ 790
MLflow
AI Infrastructure
The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables te
Apache-2.0vs Weights & Biases★ 28k
SaaS alternatives to LangWatch
See all
LangSmith
AI Infrastructure
Observability, tracing and evaluation platform for LLM applications
SaaS
Arize AI
AI Infrastructure
Observability and evaluation platform for machine learning models and LLM applications
SaaS
Braintrust
AI Infrastructure
Evaluation and observability platform for building and testing AI applications
SaaS
Galileo
AI Infrastructure
Evaluation and monitoring platform for generative AI applications
SaaS
Portkey
AI Infrastructure
AI gateway and observability platform for managing LLM requests
SaaS
Comet
AI Infrastructure
Experiment tracking, model registry and LLM evaluation platform
SaaS

