Judgeval SDK Reference
Reference documentation for the Judgeval SDK
Use the Judgeval Python or TypeScript SDK to query project data with SQL, trace agent execution, run evaluations, and manage datasets.
For programmatic queries, call sql(...) after inspecting the Python SQL reference or TypeScript SQL reference. You can also fetch the schema with Python’s discover_schema() or TypeScript’s discoverSchema(). The SQL guide covers setup, query examples, and limits. For agent workflows, use the Judgment MCP server.
Core SDK Components
Judgeval
Primary client for SQL queries, evaluations, and datasets
SQL
Discover the virtual schema and run read-only queries over project data
Tracer
Capture and monitor agent execution traces for debugging and analysis
Dataset
Manage collections of examples for batch evaluation
Judge
Create custom local scorers with typed responses
Judgeval
Primary client for SQL queries, evaluations, and datasets
SQL
Discover the virtual schema and run read-only queries over project data
Tracer
Capture and monitor agent execution traces for debugging and analysis
JudgmentTracerProvider
Global singleton managing tracer registration and context propagation