HuggingFace Integration

If you use HuggingFace Transformers within your application, you can trace, monitor, and analyze them with Judgment using TransformersInstrumentor.

OpenTelemetry

pip install opentelemetry-instrumentation-transformers

from judgeval import Tracer
# Make sure you installed the dependency: opentelemetry-instrumentation-transformers
from opentelemetry.instrumentation.transformers import TransformersInstrumentor

Tracer.init(project_name="huggingface_project")
Tracer.registerOTELInstrumentation(TransformersInstrumentor())