Model Providers

Anthropic

If you use Anthropic models within your application, you can trace, monitor, and analyze them with Judgment. You can do this by either

  1. Judgeval Wrap: Add our wrap around the initialization of your client
  2. OpenTelemetry: Use the AnthropicInstrumentor library to wrap Anthropic SDK calls and send Otel spans to Judgment.

Judgeval Wrap

from anthropic import Anthropic
from judgeval import Judgeval

client = Judgeval(project_name="anthropic_project")
tracer = client.tracer.create()

anthropic_client = Anthropic()
wrapped_client = tracer.wrap(anthropic_client)  # Use wrapped_client from here on

OpenTelemetry

from judgeval import Judgeval
# Make sure you installed the dependency: opentelemetry-instrumentation-anthropic
from opentelemetry.instrumentation.anthropic import AnthropicInstrumentor

client = Judgeval(project_name="anthropic_project")
tracer = client.tracer.create()
AnthropicInstrumentor().instrument()

Always initialize the Tracer before calling AnthropicInstrumentor().instrument() to ensure proper trace routing.

Only use one of these options to trace Anthropic calls or you may see duplicate tracing.