Model Providers

Vertex AI

If you use Google Cloud Vertex AI within your application, you can trace, monitor, and analyze them with Judgment using VertexAIInstrumentor.

OpenTelemetry

pip install opentelemetry-instrumentation-vertexai
from judgeval.tracer import Tracer
# Make sure you installed the dependency: opentelemetry-instrumentation-vertexai
from opentelemetry.instrumentation.vertexai import VertexAIInstrumentor


tracer = Tracer(project_name="vertexai_project")
VertexAIInstrumentor().instrument()

Always initialize the Tracer before calling VertexAIInstrumentor().instrument() to ensure proper trace routing.

Vertex AI is Google Cloud's unified ML platform. This instrumentation works with both Gemini models and other models available through Vertex AI.

On this page