Judgment Labs Logo
DocumentationSDK ReferenceChangelog
Model Providers

HuggingFace

If you use HuggingFace Transformers within your application, you can trace, monitor, and analyze them with Judgment using TransformersInstrumentor.

OpenTelemetry

pip install opentelemetry-instrumentation-transformers
from judgeval import Judgeval
# Make sure you installed the dependency: opentelemetry-instrumentation-transformers
from opentelemetry.instrumentation.transformers import TransformersInstrumentor

client = Judgeval(project_name="huggingface_project")
tracer = client.tracer.create()
TransformersInstrumentor().instrument()

Always initialize the Tracer before calling TransformersInstrumentor().instrument() to ensure proper trace routing.

This instrumentation automatically traces text generation calls sent with the HuggingFace Transformers library.

Together AI

Previous Page

Vertex AI

Next Page

Last updated on

On this page

OpenTelemetry