API reference
LangSmith API reference
observability, evaluation, tracing, and prompt engineering platform for production LLM applications
- Identifiers
- 48
- With full guides
- 0
- Types
- 8
Topics covered
- Client
- traceable decorator
- wrap_openai
- RunTree spans
- Evaluation datasets
- expect assertions
- Online evaluators
- Pytest plugin
Class
| Name | What it does |
|---|
Client | Class |
AsyncClient | Class |
RunTree | Class |
ApiKeyAuth | Class |
DynamicRunEvaluator | Class |
ExactMatchEvaluator | Class |
CriteriaEvaluator | Class |
EmbeddingDistanceEvaluator | Class |
Function
| Name | What it does |
|---|
wrap_openai | Function |
evaluate | Function |
expect | Function |
tracing_context | Function |
as_run_evaluator | Function |
aevaluate | Function |
get_current_run_tree | Function |
create_presigned_url | Function |
run_on_dataset | Function |
wrap_anthropic | Function |
create_llm_as_judge | Function |
create_dataset | Function |
create_feedback | Function |
push_prompt | Function |
pull_prompt | Function |
Interface
| Name | What it does |
|---|
RunEvaluator | Interface |
StringEvaluator | Interface |
Type Alias
| Name | What it does |
|---|
EvaluationResult | Type Alias |
Run | Type Alias |
Dataset | Type Alias |
Feedback | Type Alias |
Example | Type Alias |
Trace | Type Alias |
FeedbackSource | Type Alias |
FeedbackCategory | Type Alias |
ScoreType | Type Alias |
Const
| Name | What it does |
|---|
LANGSMITH_TRACING | Const |
LANGSMITH_API_KEY | Const |
LANGSMITH_PROJECT | Const |
LANGSMITH_ENDPOINT | Const |
Enum
| Name | What it does |
|---|
RunType | Enum |
Decorator
| Name | What it does |
|---|
traceable | Decorator |
unit | Decorator |
pytest.mark.langsmith | Decorator |
Module
| Name | What it does |
|---|
pytest-plugin | Module |
Metadata & tags | Module |
Threads | Module |
Distributed tracing | Module |
Pairwise evaluation | Module |
Vitest & Jest | Module |
Search across every package and filter by type in your dashboard.
Start learning