Third-Party Integrations

Third-party integrations extend Judgment's capabilities by automatically capturing traces from popular AI frameworks and observability tools. These integrations eliminate the need for manual instrumentation, providing seamless monitoring of your AI applications.

How Integrations Work

Integrations automatically capture traces from your existing AI frameworks and send them to Judgment. This requires minimal code changes:

Initialize the Integration

The top of your file should look like this:

from judgeval.tracer import Tracer
from judgeval.integrations.framework import FrameworkIntegration

tracer = Tracer(project_name="your_project")
FrameworkIntegration.initialize()

Always initialize the Tracer before calling any integration's initialize() method.

Next Steps

Choose an integration that matches your AI framework:

Agent Frameworks

For multi-agent workflows and graph-based AI applications.

OpenLit Integration

For applications using OpenLit for observability.