Skip to content
Judgment Labs
Esc
↑↓navigate↵open⌘Jpreview
On this page

TestConfig

A reusable offline-test configuration (dataset + judges).

Created via client.offline_tests.create_config(). A test config pins a dataset and a set of platform judges; each run() against it creates a new test run.

Attributes

PropType
id?str

Unique test config ID.

Typestr
name?str

Config name.

Typestr
dataset_id?str

The dataset evaluated by this config.

Typestr
description?Optional[str]

Optional human-readable description.

TypeOptional[str]
DefaultNone
created_at?Optional[str]

ISO-8601 creation timestamp.

TypeOptional[str]
DefaultNone
judges?List[Dict[str, Any]]

The judge membership rows as returned by the server.

TypeList[Dict[str, Any]]
Defaultfield(default_factory=list)

from_dict()

def from_dict(data) -> TestConfig:

Parameters

PropType
dataDict[str, Any]
TypeDict[str, Any]

Returns

TestConfig

Was this page helpful?