Skip to Content
Judgment Labs

Choose an integration

Find the integration that fits how your agent is built, in Python or TypeScript.

Judgment ingests OpenTelemetry spans, and each integration is a different way to create them and hand them to the Judgment exporter. Every page in this section assumes you've initialized the SDK as in Set up tracing, with JUDGMENT_API_KEY and JUDGMENT_ORG_ID set.

Pick the row for whatever does the most work in your agent. That's usually the framework running the tool loop rather than the model client underneath it.

What creates your spansPythonTypeScriptPage
You call the OpenAI client directlywrap()wrap()Model clients
You call Anthropic, Together, or Google GenAI directlywrap()OpenTelemetry instrumentationModel clients
Bedrock, Vertex AI, Groq, Ollama, LiteLLM, other providersOpenTelemetry instrumentorOpenTelemetry instrumentationModel clients
LangGraph or LangChainOpenInference instrumentorSend OTLPLangGraph and LangChain
OpenAI Agents SDKOpenInference instrumentorSend OTLPOpenAI Agents SDK
Claude Agent SDKsetup_claude_agent_sdk()Send OTLPClaude Agent SDK
Claude Managed AgentsNot applicablewrapAnthropicManagedAgents()Claude Agent SDK
Vercel AI SDKNot applicableAI SDK telemetryVercel AI SDK
Google ADK, Pipecat, LiveKit Agents, Pydantic AIInstall Judgment as the global providerSend OTLPFrameworks with built-in OpenTelemetry
FastAPI, Flask, Django, httpx, SQLAlchemy, Redis, Celery, and other librariesTracer.registerOTELInstrumentation()Tracer.registerOTELInstrumentation()OpenTelemetry instrumentation libraries
An OpenTelemetry SDK or Collector you already run, any language, OpenClawOTLP over HTTPOTLP over HTTPSend OTLP directly
Logfire, LangSmith, Braintrust, or LangfuseDual exportDual exportKeep your existing tool

"Send OTLP" in the TypeScript column means Judgment has no TypeScript helper for that framework. If the framework emits OpenTelemetry spans through the global provider, call JudgmentTracerProvider.installAsGlobalTracerProvider() after Tracer.init() so they go through the SDK to Judgment. Otherwise, point its exporter at Judgment.

What's one line and what's real setup

  • wrap(), setup_claude_agent_sdk(), and, for most libraries, Tracer.registerOTELInstrumentation(...) are one line after Tracer.init.
  • Frameworks that only read the global OpenTelemetry provider need one extra call, JudgmentTracerProvider.install_as_global_tracer_provider() in Python or JudgmentTracerProvider.installAsGlobalTracerProvider() in TypeScript. Tracer.init doesn't install it for you.
  • Raw OTLP and dual export are real setup. You build the exporter, set three headers, and need the project ID instead of the project name.

Rules for every integration

  • Record each model call once. If a framework integration already records the model call, don't also wrap() the client or add a provider instrumentor. You'd get duplicate model spans, tokens, and cost.
  • Keep one project name per agent. The name creates the project if it doesn't exist (Set up tracing explains the lookup). Use environment= for dev, staging, and production.
  • Flush before short-lived processes exit. Scripts, Lambda handlers, and CLI tools should call Tracer.force_flush() (Python) or await Tracer.shutdown() (TypeScript) before they return.

On this page