Model Providers
HuggingFace
If you use HuggingFace Transformers within your application, you can trace, monitor, and analyze them with Judgment using TransformersInstrumentor.
OpenTelemetry
pip install opentelemetry-instrumentation-transformersfrom judgeval.tracer import Tracer
# Make sure you installed the dependency: opentelemetry-instrumentation-transformers
from opentelemetry.instrumentation.transformers import TransformersInstrumentor
tracer = Tracer(project_name="huggingface_project")
TransformersInstrumentor().instrument()Last updated on