Model Providers
HuggingFace
If you use HuggingFace Transformers within your application, you can trace, monitor, and analyze them with Judgment using TransformersInstrumentor.
OpenTelemetry
pip install opentelemetry-instrumentation-transformersfrom judgeval import Tracer
# Make sure you installed the dependency: opentelemetry-instrumentation-transformers
from opentelemetry.instrumentation.transformers import TransformersInstrumentor
Tracer.init(project_name="huggingface_project")
Tracer.registerOTELInstrumentation(TransformersInstrumentor())Last updated on