Langsmith MCP Server — Hosted Api Connectors Integration
MCP Server language Hosted language PublicLLM observability and tracing via LangSmith — list projects, query traces, view feedback, and monitor AI runs.
Use with AI AssistantsMCP
Connect Claude, Cursor, or any MCP-compatible client — then call tools directly
① Add This MCP Server
Paste into your AI client config — then all its tools are available instantly.
{
"mcpServers": {
"langsmith": {
"url": "https://mcp.aerostack.dev/s/aerostack/mcp-langsmith",
"headers": {
"Authorization": "Bearer YOUR_AEROSTACK_TOKEN"
}
}
}
}Replace YOUR_AEROSTACK_TOKEN with your API token from the dashboard.
② Call a Tool
Ask your AI assistant to call a specific tool, or send raw JSON-RPC:
Natural Language Prompt
“Use the _ping tool to verify langsmith credentials by calling a lightweight read endpoint. used internally by aerostack to validate credentials”
Using a Workspace?
Add this MCP to your Workspace — your team shares one token, secrets are stored securely, and every AI agent in the workspace can call it without per-user setup.
description Overview
mcp-langsmith — Langsmith MCP Server
LLM observability and tracing via LangSmith — list projects, query traces, view feedback, and monitor AI runs.
Live endpoint: https://mcp.aerostack.dev/s/aerostack/mcp-langsmith
What You Can Do
This MCP server gives AI agents access to Langsmith via 8 tools. Connect it to any Aerostack workspace and your agents can interact with Langsmith directly.
Available Tools
| Tool | Description |
|---|---|
list_projects |
List LangSmith projects (repos/tracing sessions) in your workspace. Each project groups related LLM runs for observability. |
create_project |
Create a new LangSmith project for grouping LLM runs and traces. |
list_runs |
List LLM runs (traces) in a LangSmith project. Returns inputs, outputs, latency, and token usage for each run. |
get_run |
Get detailed information about a specific LangSmith run including full inputs, outputs, error info, and child runs. |
list_datasets |
List evaluation datasets in your LangSmith workspace for testing and benchmarking LLM applications. |
create_dataset |
Create a new evaluation dataset in LangSmith for storing input/output examples to benchmark your LLM. |
list_examples |
List examples (test cases) in a LangSmith evaluation dataset. |
create_example |
Add a new input/output example to a LangSmith evaluation dataset for benchmarking. |
Configuration
| Variable | Required | Description |
|---|---|---|
LANGSMITH_API_KEY |
Yes | Your LANGSMITH API KEY from the service's developer settings |
Quick Start
Add to Aerostack Workspace
- Go to aerostack.dev → Your Project → MCPs
- Search for "Langsmith" and click Add to Workspace
Add the following secrets under Project → Secrets:
LANGSMITH_API_KEY
Once added, every AI agent in your workspace can use Langsmith tools automatically.
Direct API Call
curl -X POST https://mcp.aerostack.dev/s/aerostack/mcp-langsmith \
-H 'Content-Type: application/json' \
-H 'X-Mcp-Secret-LANGSMITH-API-KEY: your-langsmith-api-key' \
-d '{"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"list_projects","arguments":{}}}'
License
MIT
terminal Tools (9)
Available tools on this MCP server. Each tool can be called directly from any AI agent.
_ping #1 Verify LangSmith credentials by calling a lightweight read endpoint. Used internally by Aerostack to validate credentials.
list_projects #2 List LangSmith projects (repos/tracing sessions) in your workspace. Each project groups related LLM runs for observability.
create_project #3 Create a new LangSmith project for grouping LLM runs and traces.
list_runs #4 List LLM runs (traces) in a LangSmith project. Returns inputs, outputs, latency, and token usage for each run.
get_run #5 Get detailed information about a specific LangSmith run including full inputs, outputs, error info, and child runs.
list_datasets #6 List evaluation datasets in your LangSmith workspace for testing and benchmarking LLM applications.
create_dataset #7 Create a new evaluation dataset in LangSmith for storing input/output examples to benchmark your LLM.
list_examples #8 List examples (test cases) in a LangSmith evaluation dataset.
create_example #9 Add a new input/output example to a LangSmith evaluation dataset for benchmarking.
Details
language Live Endpoint
https://mcp.aerostack.dev/s/aerostack/mcp-langsmith
Sub-50ms globally · Zero cold start
Publisher
Pre-built functions for the most common MCP tool patterns. Clone, extend, and deploy.
More in API Connectors
Browse API Connectors MCPs →Aerostack Registry
by @aerostack
Discover and invoke any MCP, Function, or Skill published to the Aerostack marketplace — the universal AI capability hub.
Algolia
by @aerostack
Search indexes, manage records, browse data, and configure ranking in Algolia — AI-native instant search access.
Arangodb
by @aerostack
Query documents, run AQL, traverse graphs, and manage collections in your ArangoDB database — AI-native multi-model database access.
Ayrshare
by @aerostack
Post, schedule, and analyze social media across 13 platforms — Facebook, Instagram, X, LinkedIn, TikTok, Bluesky, Threads, Reddit, Pinterest, YouTube, Telegram, Snapchat, Google Business.
Basecamp
by @aerostack
Manage projects, to-dos, messages, schedules, and campfire chats in Basecamp — AI-native project management.
Bigquery
by @aerostack
Run SQL queries, list datasets and tables, inspect schemas, and export results from Google BigQuery — AI-native data warehouse access.
Frequently asked questions
What is the Langsmith MCP server and what can it do? +
The Langsmith MCP server is hosted on Aerostack and exposes these tools to your AI agent: `_ping`, `list_projects`, `create_project`, `list_runs`, `get_run`. You get one hosted URL — no self-hosting — that works from Claude, Cursor, ChatGPT, Gemini, VS Code, or any MCP-compatible client, and you can share it with your team or combine it with other MCP servers in a workspace.
Is the Langsmith MCP server hosted, or do I have to run it myself? +
It's hosted on Aerostack's edge infrastructure — you don't deploy or maintain anything. Add it to a workspace and you get one authenticated URL, with secrets encrypted, that any AI agent or editor can connect to. Use it solo or share the same URL across your whole team.
Which AI agents and editors can use the Langsmith MCP server? +
Any MCP client: Claude and Claude Code, Cursor, ChatGPT, Gemini, Windsurf, Cline, VS Code, and custom agents. Because it's one hosted URL, the same Langsmith MCP server works everywhere — and you can compose it with other MCP servers, skills, and functions behind a single workspace URL.
How do I install the Langsmith MCP server in Claude Desktop? +
Add the following to your Claude Desktop config (`claude_desktop_config.json`): ```json { "mcpServers": { "@aerostack/mcp-langsmith": { "command": "npx", "args": ["-y", "@aerostack/@aerostack/mcp-langsmith"] } } } ``` Then restart Claude Desktop and the tools will appear automatically.
How do I use the Langsmith MCP server in Cursor? +
In Cursor, open **Settings → MCP** and add: ```json { "name": "@aerostack/mcp-langsmith", "command": "npx", "args": ["-y", "@aerostack/@aerostack/mcp-langsmith"] } ``` Save and reload Cursor. The MCP tools will be available in Agent mode.
Does Langsmith MCP require authentication? +
Yes. Langsmith requires authentication. Check the MCP's documentation for the required credentials.