Judgment Labs Logo
DocumentationSDK ReferenceInteractive DemoChangelog
Model Providers

Anthropic

If you use Anthropic models within your application, you can trace, monitor, and analyze them with Judgment. You can do this by either

  1. Judgeval Wrap: Add our wrap around the initialization of your client
  2. OpenTelemetry: Use the AnthropicInstrumentor library to wrap Anthropic SDK calls and send Otel spans to Judgment.

Judgeval Wrap

from anthropic import Anthropic
from judgeval.tracer import wrap

client = Anthropic()
wrapped_client = wrap(client)  # Use wrapped_client from here on

OpenTelemetry

from judgeval.tracer import Tracer
# Make sure you installed the dependency: opentelemetry-instrumentation-anthropic
from opentelemetry.instrumentation.anthropic import AnthropicInstrumentor


tracer = Tracer(project_name="anthropic_agents_project")
AnthropicInstrumentor().instrument()

Always initialize the Tracer before calling AnthropicInstrumentor().instrument() to ensure proper trace routing.

Only use one of these options to trace Anthropic calls or you may see duplicate tracing.

Vercel AI SDK

Automatically trace Vercel AI SDK agent executions, tool calls, and multi-step workflows.

OpenAI

Next Page

Last updated on

On this page

Judgeval WrapOpenTelemetry