Model Providers

Vertex AI

If you use Google Cloud Vertex AI within your application, you can trace, monitor, and analyze them with Judgment using VertexAIInstrumentor.

OpenTelemetry

pip install opentelemetry-instrumentation-vertexai
from judgeval import Tracer
# Make sure you installed the dependency: opentelemetry-instrumentation-vertexai
from opentelemetry.instrumentation.vertexai import VertexAIInstrumentor

Tracer.init(project_name="vertexai_project")
Tracer.registerOTELInstrumentation(VertexAIInstrumentor())

Vertex AI is Google Cloud's unified ML platform. This instrumentation works with both Gemini models and other models available through Vertex AI.

On this page