Vertex AI

If you use Google Cloud Vertex AI within your application, you can trace, monitor, and analyze them with Judgment using VertexAIInstrumentor.

OpenTelemetry

pip install opentelemetry-instrumentation-vertexai

from judgeval import Judgeval
# Make sure you installed the dependency: opentelemetry-instrumentation-vertexai
from opentelemetry.instrumentation.vertexai import VertexAIInstrumentor

client = Judgeval(project_name="vertexai_project")
tracer = client.tracer.create()
VertexAIInstrumentor().instrument()

Always initialize the Tracer before calling VertexAIInstrumentor().instrument() to ensure proper trace routing.

Vertex AI is Google Cloud's unified ML platform. This instrumentation works with both Gemini models and other models available through Vertex AI.

Vertex AI

OpenTelemetry

On this page