About LangSmith
LangSmith is a platform from LangChain for seeing what LLM applications and agents actually do. It records step-by-step traces so developers can find failures, track cost and latency, and measure response quality.
Tracing works natively with popular agent frameworks and OpenTelemetry, with SDKs for Python, TypeScript, Go and Java, and it supports message threading for multi-turn chats. Beyond observability, the platform offers evaluation to score agent performance, deployment for shipping agents, sandboxes for running generated code safely, an LLM gateway to control model calls, and no-code agents through Fleet. LangChain also maintains the open-source LangChain, LangGraph and deepagents frameworks.
LangSmith is a proprietary commercial service with a try-it option, a demo request and a published pricing page. It suits teams building agents with LangChain tools as well as teams using other frameworks.
Key features
- Step-by-step agent and LLM tracing
- Evaluation and scoring of agent performance
- SDKs for Python, TypeScript, Go and Java
- OpenTelemetry support
- Agent deployment and sandboxes
- LLM gateway for model calls
Good fit for
- →Debugging failures in LLM agents
- →Tracking cost and latency of AI applications
- →Evaluating agent quality before release
- Tags
- llm-observability
- tracing
- evaluation
- langchain
- agents
- llmops
- monitoring
- ai-infrastructure
LangSmith: questions and answers
- What is LangSmith used for?
- LangSmith is an observability, tracing and evaluation platform from LangChain for debugging and improving LLM applications and AI agents in production. It is a good fit for debugging failures in LLM agents, tracking cost and latency of AI applications, and evaluating agent quality before release.
- Is LangSmith free?
- Yes. LangSmith has a free plan, and paid plans start at $39 per seat per month.
- Is LangSmith open source?
- No. LangSmith is proprietary (closed-source) software. Open-source alternatives to LangSmith include Opik, Arize Phoenix and Langfuse.
- Can I self-host LangSmith?
- Yes. Although LangSmith is closed source, it can be self-hosted on your own servers, and the vendor also offers a hosted version.
- What are some alternatives to LangSmith?
- LangSmith competes with Arize AI, Braintrust and Weights & Biases. For open-source options, see Enlisted's ranked list of open-source LangSmith alternatives.
Open-source alternatives to LangSmith
See all
Opik
AI Infrastructure
Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows wit
Apache-2.0vs Weights & Biases★ 22k
Arize Phoenix
AI Infrastructure
AI Observability & Evaluation
OSSvs Weights & Biases★ 12k
Langfuse
AI Infrastructure
Trace, evaluate, and improve AI agents with one open platform. Use production data to unde
OSSvs Weights & Biases★ 35k
MLflow
AI Infrastructure
The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables te
Apache-2.0vs Weights & Biases★ 28k
Helicone
AI Infrastructure
🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and expe
Apache-2.0vs OpenRouter★ 6.2k
TraceRoot
AI Infrastructure
TraceRoot - open source self improving layer for ai agents YC S25
OSSvs Weights & Biases★ 790
SaaS alternatives to LangSmith
See all
Arize AI
AI Infrastructure
Observability and evaluation platform for machine learning models and LLM applications
SaaS
Braintrust
AI Infrastructure
Evaluation and observability platform for building and testing AI applications
SaaS
Weights & Biases
AI Infrastructure
Experiment tracking, model registry and LLM evaluation for machine learning teams
SaaS
Galileo
AI Infrastructure
Evaluation and monitoring platform for generative AI applications
SaaS
Comet
AI Infrastructure
Experiment tracking, model registry and LLM evaluation platform
SaaS
Vellum
AI Infrastructure
Platform for building, testing and monitoring LLM prompts and workflows
SaaS

