Get judge

Get one selected version of a judge, including its definition, outputs, version metadata, pinned preprocessing artifact revision, and online-evaluation settings. Also returns optimistic_eval_eligibility with authoritative BYOK and SaaS-runtime checks and configuration blockers. Eligibility is independent of the toggle and attached script; it does not establish extraction reliability, verdict agreement, feature availability, or permission to enable execution. Defaults to the latest version. For Code judges, set include_code_url=true to receive a temporary download URL for the source bundle. Bundle contents are omitted.

POST/v1/projects/{projectId}/judges/{judgeId}/lookup

Authorization

AuthorizationPersonal API key · headerrequired

Your personal API key from Settings > Personal API Keys, sent as Bearer <key>.

X-Organization-IdOrganization ID · headerrequired

The organization to act in. Copy it with Copy organization ID in the organization menu or the settings sidebar.

Path parameters

projectIdstringrequired

judgeIdstring<uuid>required

The judge ID

matches ^([0-9a-fA-F]{8}-[0-9a-fA-F]{4}-[1-8][0-9a-fA-F]{3}-[89abAB][0-9a-fA-F]{3}-[0-9a-fA-F]{12}|00000000-0000-0000-0000-000000000000|ffffffff-ffff-ffff-ffff-ffffffffffff)$

Request body

requiredapplication/json

include_code_urlboolean

For custom-code judges, include a temporary download URL for the selected version’s tar.gz source bundle. Defaults to false; ignored for other judge types.

versionstring | object

Judge version to return. Defaults to 'latest'; use 'production' or provide an exact major/minor version.

Show properties

Any of:

string

string

object

majorintegerrequired

min 0 · max 9007199254740991

minorintegerrequired

min 0 · max 9007199254740991

Responses

200

Response for status 200

optimistic_eval_eligibilityobjectrequired

Show properties

supportedbooleanrequired

byok_enabledbooleanrequired

saas_runtimebooleanrequired

blockersstring[]required

judgeobjectrequired

Show properties

One of:

object

idstringrequired

namestringrequired

judge_descriptionstring | nullrequired

knowledge_file_idstring | nullrequired

score_typestringrequired

Allowed:numericbinarycategorical

outputsobject[]required

Show properties

Array of object

behavior_idstringrequired

namestringrequired

descriptionstringrequired

judge_version_idstringrequired

judge_major_versionnumberrequired

judge_minor_versionnumberrequired

is_latestbooleanrequired

is_productionbooleanrequired

optimistic_eval_enabledbooleanrequired

preprocessor_artifact_revision_idstring | nullrequired

version_created_atstringrequired

version_updated_atstringrequired

updated_byobject | nullrequired

Show properties

Any of:

object

user_idstringrequired

first_namestringrequired

last_namestringrequired

user_emailstringrequired

null

null

online_environment_namesstring[] | nullrequired

Show properties

Any of:

string[]

Array of string

string

null

null

online_evaluation_modestringrequired

Allowed:continuouson_demand

action_configobject | null

Show properties

Any of:

object

action_groupsobject[]required

Show properties

Array of object

idstringrequired

min length 1

namestringrequired

Action group display name; an empty string uses Action group 1, 2, etc.

enabledbooleanrequired

environment_namesstring[]required

Empty runs the group in every environment

whenobjectrequired

Judge result that runs the group. Categorical groups run when the result is any listed output name.

Show properties

One of:

object

kindstringrequired

object

kindstringrequired

valuebooleanrequired

object

kindstringrequired

valuesstring[]required

min items 1

object

kindstringrequired

operatorstringrequired

Allowed:ltlteeqgtegt

valuenumberrequired

frequencyobjectrequired

Show properties

countintegerrequired

min 1 · max 9007199254740991

window_secondsintegerrequired

min 1 · max 9007199254740991

cooldown_secondsintegerrequired

min 0 · max 9007199254740991

actionsobject[]required

Show properties

Array of object

One of:

object

idstringrequired

min length 1

enabledbooleanrequired

typestringrequired

configobjectrequired

Show properties

urlstringrequired

min length 1

secretstringrequired

min length 1

object

idstringrequired

min length 1

enabledbooleanrequired

typestringrequired

configobjectrequired

Show properties

email_addressstringrequired

min length 1

object

idstringrequired

min length 1

enabledbooleanrequired

typestringrequired

configobjectrequired

Show properties

team_idstring

min length 1

channel_idstring

min length 1

messagestring

custom_attribute_keysstring[]

object

idstringrequired

min length 1

enabledbooleanrequired

typestringrequired

configobjectrequired

Show properties

dataset_idstringrequired

min length 1

object

idstringrequired

min length 1

enabledbooleanrequired

typestringrequired

configobjectrequired

Show properties

judge_idsstring[]required

min items 1

null

null

online_sampling_ratenumberrequired

online_span_triggersany | objectrequired

Show properties

Any of:

any

any

object

kindstringrequired

Allowed:andor

conditionsany[]required

online_session_scoringbooleanrequired

session_evaluation_count_enabledboolean | nullrequired

session_evaluation_idle_enabledboolean | nullrequired

session_evaluation_min_candidate_tracesnumber | nullrequired

session_evaluation_max_wait_minutesnumber | nullrequired

judge_typestringrequired

Agent judge (wire value prompt)

definitionobjectrequired

Show properties

idstringrequired

descriptionstring | nullrequired

promptstringrequired

reasoning_levelstringrequired

Allowed:litenormalhigh

min_scorenumberrequired

max_scorenumberrequired

modelstringrequired

thresholdnumberrequired

object

idstringrequired

namestringrequired

judge_descriptionstring | nullrequired

knowledge_file_idstring | nullrequired

score_typestringrequired

Allowed:numericbinarycategorical

outputsobject[]required

Show properties

Array of object

behavior_idstringrequired

namestringrequired

descriptionstringrequired

judge_version_idstringrequired

judge_major_versionnumberrequired

judge_minor_versionnumberrequired

is_latestbooleanrequired

is_productionbooleanrequired

optimistic_eval_enabledbooleanrequired

preprocessor_artifact_revision_idstring | nullrequired

version_created_atstringrequired

version_updated_atstringrequired

updated_byobject | nullrequired

Show properties

Any of:

object

user_idstringrequired

first_namestringrequired

last_namestringrequired

user_emailstringrequired

null

null

online_environment_namesstring[] | nullrequired

Show properties

Any of:

string[]

Array of string

string

null

null

online_evaluation_modestringrequired

Allowed:continuouson_demand

action_configobject | null

Show properties

Any of:

object

action_groupsobject[]required

Show properties

Array of object

idstringrequired

min length 1

namestringrequired

Action group display name; an empty string uses Action group 1, 2, etc.

enabledbooleanrequired

environment_namesstring[]required

Empty runs the group in every environment

whenobjectrequired

Judge result that runs the group. Categorical groups run when the result is any listed output name.

Show properties

One of:

object

kindstringrequired

object

kindstringrequired

valuebooleanrequired

object

kindstringrequired

valuesstring[]required

min items 1

object

kindstringrequired

operatorstringrequired

Allowed:ltlteeqgtegt

valuenumberrequired

frequencyobjectrequired

Show properties

countintegerrequired

min 1 · max 9007199254740991

window_secondsintegerrequired

min 1 · max 9007199254740991

cooldown_secondsintegerrequired

min 0 · max 9007199254740991

actionsobject[]required

Show properties

Array of object

One of:

object

idstringrequired

min length 1

enabledbooleanrequired

typestringrequired

configobjectrequired

Show properties

urlstringrequired

min length 1

secretstringrequired

min length 1

object

idstringrequired

min length 1

enabledbooleanrequired

typestringrequired

configobjectrequired

Show properties

email_addressstringrequired

min length 1

object

idstringrequired

min length 1

enabledbooleanrequired

typestringrequired

configobjectrequired

Show properties

team_idstring

min length 1

channel_idstring

min length 1

messagestring

custom_attribute_keysstring[]

object

idstringrequired

min length 1

enabledbooleanrequired

typestringrequired

configobjectrequired

Show properties

dataset_idstringrequired

min length 1

object

idstringrequired

min length 1

enabledbooleanrequired

typestringrequired

configobjectrequired

Show properties

judge_idsstring[]required

min items 1

null

null

online_sampling_ratenumberrequired

online_span_triggersany | objectrequired

Show properties

Any of:

any

any

object

kindstringrequired

Allowed:andor

conditionsany[]required

online_session_scoringbooleanrequired

session_evaluation_count_enabledboolean | nullrequired

session_evaluation_idle_enabledboolean | nullrequired

session_evaluation_min_candidate_tracesnumber | nullrequired

session_evaluation_max_wait_minutesnumber | nullrequired

judge_typestringrequired

Code judge (wire value custom)

definitionobjectrequired

Show properties

idstringrequired

descriptionstring | nullrequired

class_namestring | nullrequired

entrypoint_pathstringrequired

requirements_pathstring | nullrequired

scorer_typestring | nullrequired

Show properties

Any of:

string

string

null

null

sdk_versionnumberrequired

code_urlstring<uri>

Presigned tar.gz bundle URL, present only when include_code_url is true. Download promptly; the URL lasts at most 55 minutes. Extract the archive to read individual source files.

object

idstringrequired

namestringrequired

judge_descriptionstring | nullrequired

knowledge_file_idstring | nullrequired

score_typestringrequired

Allowed:numericbinarycategorical

outputsobject[]required

Show properties

Array of object

behavior_idstringrequired

namestringrequired

descriptionstringrequired

judge_version_idstringrequired

judge_major_versionnumberrequired

judge_minor_versionnumberrequired

is_latestbooleanrequired

is_productionbooleanrequired

optimistic_eval_enabledbooleanrequired

preprocessor_artifact_revision_idstring | nullrequired

version_created_atstringrequired

version_updated_atstringrequired

updated_byobject | nullrequired

Show properties

Any of:

object

user_idstringrequired

first_namestringrequired

last_namestringrequired

user_emailstringrequired

null

null

online_environment_namesstring[] | nullrequired

Show properties

Any of:

string[]

Array of string

string

null

null

online_evaluation_modestringrequired

Allowed:continuouson_demand

action_configobject | null

Show properties

Any of:

object

action_groupsobject[]required

Show properties

Array of object

idstringrequired

min length 1

namestringrequired

Action group display name; an empty string uses Action group 1, 2, etc.

enabledbooleanrequired

environment_namesstring[]required

Empty runs the group in every environment

whenobjectrequired

Judge result that runs the group. Categorical groups run when the result is any listed output name.

Show properties

One of:

object

kindstringrequired

object

kindstringrequired

valuebooleanrequired

object

kindstringrequired

valuesstring[]required

min items 1

object

kindstringrequired

operatorstringrequired

Allowed:ltlteeqgtegt

valuenumberrequired

frequencyobjectrequired

Show properties

countintegerrequired

min 1 · max 9007199254740991

window_secondsintegerrequired

min 1 · max 9007199254740991

cooldown_secondsintegerrequired

min 0 · max 9007199254740991

actionsobject[]required

Show properties

Array of object

One of:

object

idstringrequired

min length 1

enabledbooleanrequired

typestringrequired

configobjectrequired

Show properties

urlstringrequired

min length 1

secretstringrequired

min length 1

object

idstringrequired

min length 1

enabledbooleanrequired

typestringrequired

configobjectrequired

Show properties

email_addressstringrequired

min length 1

object

idstringrequired

min length 1

enabledbooleanrequired

typestringrequired

configobjectrequired

Show properties

team_idstring

min length 1

channel_idstring

min length 1

messagestring

custom_attribute_keysstring[]

object

idstringrequired

min length 1

enabledbooleanrequired

typestringrequired

configobjectrequired

Show properties

dataset_idstringrequired

min length 1

object

idstringrequired

min length 1

enabledbooleanrequired

typestringrequired

configobjectrequired

Show properties

judge_idsstring[]required

min items 1

null

null

online_sampling_ratenumberrequired

online_span_triggersany | objectrequired

Show properties

Any of:

any

any

object

kindstringrequired

Allowed:andor

conditionsany[]required

online_session_scoringbooleanrequired

session_evaluation_count_enabledboolean | nullrequired

session_evaluation_idle_enabledboolean | nullrequired

session_evaluation_min_candidate_tracesnumber | nullrequired

session_evaluation_max_wait_minutesnumber | nullrequired

judge_typestringrequired

Condition judge (wire value deterministic)

definitionobjectrequired

Show properties

idstringrequired

expressionanyrequired

Try it

Server

Base URLCustom base URLOverrides the selected server when set.

Authorization

Personal API keyOrganization IDRemember on this deviceInclude my values in samples

Parameters

projectIdpath*judgeIdpath*The judge ID

Bodyapplication/json

include_code_urlbooleanFor custom-code judges, include a temporary download URL for the selected version’s tar.gz source bundle. Defaults to false; ignored for other judge types.versionstringJudge version to return. Defaults to 'latest'; use 'production' or provide an exact major/minor version.

Request

curl -X POST 'https://api.judgmentlabs.ai/v1/projects/YOUR_PROJECT_ID/judges/YOUR_JUDGE_ID/lookup' \
  -H 'Authorization: Bearer YOUR_API_KEY' \
  -H 'X-Organization-Id: YOUR_ORGANIZATION_ID' \
  -H 'Accept: application/json' \
  -H 'Content-Type: application/json' \
  -d '{
  "include_code_url": true,
  "version": "latest"
}'

const response = await fetch("https://api.judgmentlabs.ai/v1/projects/YOUR_PROJECT_ID/judges/YOUR_JUDGE_ID/lookup", {
  method: "POST",
  headers: {
    "Authorization": "Bearer YOUR_API_KEY",
    "X-Organization-Id": "YOUR_ORGANIZATION_ID",
    "Accept": "application/json",
    "Content-Type": "application/json"
  },
  body: "{\n  \"include_code_url\": true,\n  \"version\": \"latest\"\n}"
});

import requests

response = requests.post(
    "https://api.judgmentlabs.ai/v1/projects/YOUR_PROJECT_ID/judges/YOUR_JUDGE_ID/lookup",
    headers={
        "Authorization": "Bearer YOUR_API_KEY",
        "X-Organization-Id": "YOUR_ORGANIZATION_ID",
        "Accept": "application/json",
        "Content-Type": "application/json"
    },
    data="{\n  \"include_code_url\": true,\n  \"version\": \"latest\"\n}",
)

Response

{
  "optimistic_eval_eligibility": {
    "supported": true,
    "byok_enabled": true,
    "saas_runtime": true,
    "blockers": [
      "unsupported_runtime"
    ]
  },
  "judge": {
    "id": "string",
    "name": "string",
    "judge_description": "string",
    "knowledge_file_id": "string",
    "score_type": "numeric",
    "outputs": [
      {
        "behavior_id": "string",
        "name": "string",
        "description": "string"
      }
    ],
    "judge_version_id": "string",
    "judge_major_version": 0,
    "judge_minor_version": 0,
    "is_latest": true,
    "is_production": true,
    "optimistic_eval_enabled": true,
    "preprocessor_artifact_revision_id": "string",
    "version_created_at": "string",
    "version_updated_at": "string",
    "updated_by": {
      "user_id": "string",
      "first_name": "string",
      "last_name": "string",
      "user_email": "string"
    },
    "online_environment_names": [
      "string"
    ],
    "online_evaluation_mode": "continuous",
    "action_config": {
      "action_groups": [
        {
          "id": "string",
          "name": "string",
          "enabled": true,
          "environment_names": [
            "string"
          ],
          "when": {
            "kind": "any"
          },
          "frequency": {
            "count": 1,
            "window_seconds": 1
          },
          "cooldown_seconds": 0,
          "actions": [
            {
              "id": "string",
              "enabled": true,
              "type": "webhook",
              "config": {
                "url": "string",
                "secret": "string"
              }
            }
          ]
        }
      ]
    },
    "online_sampling_rate": 0,
    "online_span_triggers": {},
    "online_session_scoring": true,
    "session_evaluation_count_enabled": true,
    "session_evaluation_idle_enabled": true,
    "session_evaluation_min_candidate_traces": 0,
    "session_evaluation_max_wait_minutes": 0,
    "judge_type": "prompt",
    "definition": {
      "id": "string",
      "description": "string",
      "prompt": "string",
      "reasoning_level": "lite",
      "min_score": 0,
      "max_score": 0,
      "model": "string",
      "threshold": 0
    }
  }
}