Judgment Labs Logo
PythonOffline TestsTypes

TestConfig

A reusable offline-test configuration (dataset + judges).

A reusable offline-test configuration (dataset + judges).

Created via client.offline_tests.create_config(). A test config pins a dataset and a set of platform judges; each run() against it creates a new test run.

Attributes

_test_

Default:

False

id

:

str

Unique test config ID.

name

:

str

Config name.

dataset_id

:

str

The dataset evaluated by this config.

description

:

Optional[str]

Optional human-readable description.

Default:

None

created_at

:

Optional[str]

ISO-8601 creation timestamp.

Default:

None

judges

:

List[Dict[str, Any]]

The judge membership rows as returned by the server.

Default:

field(default_factory=list)


from_dict()

def from_dict(data) -> TestConfig:

Parameters

data

required

:

Dict[str, Any]

Returns

TestConfig