Model Providers
Vertex AI
If you use Google Cloud Vertex AI within your application, you can trace, monitor, and analyze them with Judgment using VertexAIInstrumentor.
OpenTelemetry
pip install opentelemetry-instrumentation-vertexaifrom judgeval import Tracer
# Make sure you installed the dependency: opentelemetry-instrumentation-vertexai
from opentelemetry.instrumentation.vertexai import VertexAIInstrumentor
Tracer.init(project_name="vertexai_project")
Tracer.registerOTELInstrumentation(VertexAIInstrumentor())Last updated on