Together AI

If you use Together AI models within your application, you can trace, monitor, and analyze them with Judgment. You can do this by either

Judgeval Wrap: Add our wrap around the initialization of your client
OpenTelemetry: Use the TogetherAiInstrumentor library to wrap TogetherAI SDK calls and send Otel spans to Judgment.

Judgeval Wrap

from together import Together
from judgeval import Judgeval

client = Judgeval(project_name="together_ai_project")
tracer = client.tracer.create()

together_client = Together()
wrapped_client = tracer.wrap(together_client)  # Use wrapped_client from here on

OpenTelemetry

from judgeval import Judgeval
# Make sure you installed the dependency: opentelemetry-instrumentation-together
from opentelemetry.instrumentation.together import TogetherInstrumentor

client = Judgeval(project_name="together_ai_project")
tracer = client.tracer.create()
TogetherInstrumentor().instrument()

Always initialize the Tracer before calling TogetherInstrumentor().instrument() to ensure proper trace routing.

Together AI uses an OpenAI-compatible API, so you can also use the OpenAI SDK with Together AI's base URL and trace it using the OpenAI integration.

Only use one of these options to trace Together AI calls or you may see duplicate tracing.

Together AI

Judgeval Wrap

OpenTelemetry

On this page