---
seo:
  description: V1 and OTEL endpoints.
sidebar:
  label: Overview
title: Judgeval API
---
V1 and OTEL endpoints.

Version 1.0.0

Base URL: `https://api.judgmentlabs.ai`

## OTEL

- [`POST /otel/v1/traces`](/documentation/reference/api/otel/post-otel-v1-traces)

## V1

- [`GET /v1/organizations`](/documentation/reference/api/v1/get-v1-organizations) — List organizations available to the API key.
- [`GET /v1/organizations/memberships`](/documentation/reference/api/v1/get-v1-organizations-memberships) — List organization memberships.
- [`GET /v1/projects`](/documentation/reference/api/v1/get-v1-projects) — List projects in the selected organization.
- [`POST /v1/projects`](/documentation/reference/api/v1/post-v1-projects) — Add new project.
- [`DELETE /v1/projects/{projectId}`](/documentation/reference/api/v1/delete-v1-projects-by-project-id) — Delete project.
- [`GET /v1/projects/{projectId}/agent-versions`](/documentation/reference/api/v1/get-v1-projects-by-project-id-agent-versions)
- [`POST /v1/projects/{projectId}/agent-versions`](/documentation/reference/api/v1/post-v1-projects-by-project-id-agent-versions)
- [`GET /v1/projects/{projectId}/agent-versions/{versionId}`](/documentation/reference/api/v1/get-v1-projects-by-project-id-agent-versions-by-version-id)
- [`PUT /v1/projects/{projectId}/agent-versions/{versionId}/tags`](/documentation/reference/api/v1/put-v1-projects-by-project-id-agent-versions-by-version-id-tags)
- [`GET /v1/projects/{projectId}/artifact-revisions`](/documentation/reference/api/v1/get-v1-projects-by-project-id-artifact-revisions) — Get artifact revision.
- [`POST /v1/projects/{projectId}/artifacts`](/documentation/reference/api/v1/post-v1-projects-by-project-id-artifacts) — Create artifact.
- [`POST /v1/projects/{projectId}/artifacts/{artifactId}/revisions`](/documentation/reference/api/v1/post-v1-projects-by-project-id-artifacts-by-artifact-id-revisions) — Create artifact revision.
- [`POST /v1/projects/{projectId}/artifacts/optimistic-eval-tests`](/documentation/reference/api/v1/post-v1-projects-by-project-id-artifacts-optimistic-eval-tests) — Test optimistic eval candidate.
- [`POST /v1/projects/{projectId}/artifacts/preprocessing-tests`](/documentation/reference/api/v1/post-v1-projects-by-project-id-artifacts-preprocessing-tests) — Test preprocessing candidate.
- [`GET /v1/projects/{projectId}/attribute-mappers`](/documentation/reference/api/v1/get-v1-projects-by-project-id-attribute-mappers) — List attribute mappers.
- [`POST /v1/projects/{projectId}/attribute-mappers`](/documentation/reference/api/v1/post-v1-projects-by-project-id-attribute-mappers) — Create attribute mapper.
- [`GET /v1/projects/{projectId}/attribute-mappers/{configId}`](/documentation/reference/api/v1/get-v1-projects-by-project-id-attribute-mappers-by-config-id) — Get attribute mapper.
- [`PATCH /v1/projects/{projectId}/attribute-mappers/{configId}`](/documentation/reference/api/v1/patch-v1-projects-by-project-id-attribute-mappers-by-config-id) — Update attribute mapper.
- [`DELETE /v1/projects/{projectId}/attribute-mappers/{configId}`](/documentation/reference/api/v1/delete-v1-projects-by-project-id-attribute-mappers-by-config-id) — Delete attribute mapper.
- [`PATCH /v1/projects/{projectId}/behaviors/{behaviorId}`](/documentation/reference/api/v1/patch-v1-projects-by-project-id-behaviors-by-behavior-id) — Update judge label.
- [`GET /v1/projects/{projectId}/behaviors/{behaviorId}/analytics`](/documentation/reference/api/v1/get-v1-projects-by-project-id-behaviors-by-behavior-id-analytics) — Get judge label.
- [`GET /v1/projects/{projectId}/conversation-display-rules`](/documentation/reference/api/v1/get-v1-projects-by-project-id-conversation-display-rules) — Get conversation display rules.
- [`PUT /v1/projects/{projectId}/conversation-display-rules`](/documentation/reference/api/v1/put-v1-projects-by-project-id-conversation-display-rules) — Replace conversation display rules.
- [`POST /v1/projects/{projectId}/datasets`](/documentation/reference/api/v1/post-v1-projects-by-project-id-datasets) — Create offline-test dataset.
- [`GET /v1/projects/{projectId}/datasets`](/documentation/reference/api/v1/get-v1-projects-by-project-id-datasets) — Fetch offline-test datasets.
- [`DELETE /v1/projects/{projectId}/datasets/{datasetIdentifier}`](/documentation/reference/api/v1/delete-v1-projects-by-project-id-datasets-by-dataset-identifier) — Delete offline-test dataset.
- [`GET /v1/projects/{projectId}/datasets/{datasetIdentifier}`](/documentation/reference/api/v1/get-v1-projects-by-project-id-datasets-by-dataset-identifier) — Fetch offline-test dataset.
- [`POST /v1/projects/{projectId}/datasets/{datasetIdentifier}/examples`](/documentation/reference/api/v1/post-v1-projects-by-project-id-datasets-by-dataset-identifier-examples) — Insert examples to offline-test dataset.
- [`POST /v1/projects/{projectId}/datasets/{datasetIdentifier}/examples/remove`](/documentation/reference/api/v1/post-v1-projects-by-project-id-datasets-by-dataset-identifier-examples-remove) — Remove examples from offline-test dataset.
- [`GET /v1/projects/{projectId}/datasets/{datasetIdentifier}/page`](/documentation/reference/api/v1/get-v1-projects-by-project-id-datasets-by-dataset-identifier-page) — Fetch dataset page.
- [`GET /v1/projects/{projectId}/datasets/{datasetIdentifier}/versions`](/documentation/reference/api/v1/get-v1-projects-by-project-id-datasets-by-dataset-identifier-versions) — Fetch dataset versions.
- [`POST /v1/projects/{projectId}/eval-queue/examples`](/documentation/reference/api/v1/post-v1-projects-by-project-id-eval-queue-examples) — Queue example evaluation.
- [`POST /v1/projects/{projectId}/eval-queue/traces`](/documentation/reference/api/v1/post-v1-projects-by-project-id-eval-queue-traces) — Queue trace evaluation.
- [`POST /v1/projects/{projectId}/eval-results`](/documentation/reference/api/v1/post-v1-projects-by-project-id-eval-results) — Log evaluation results.
- [`POST /v1/projects/{projectId}/eval-results/examples`](/documentation/reference/api/v1/post-v1-projects-by-project-id-eval-results-examples) — Log evaluation results.
- [`POST /v1/projects/{projectId}/evaluate/examples`](/documentation/reference/api/v1/post-v1-projects-by-project-id-evaluate-examples) — Evaluate examples.
- [`POST /v1/projects/{projectId}/evaluate/traces`](/documentation/reference/api/v1/post-v1-projects-by-project-id-evaluate-traces) — Evaluate traces.
- [`GET /v1/projects/{projectId}/experiments/{runId}`](/documentation/reference/api/v1/get-v1-projects-by-project-id-experiments-by-run-id) — Fetch offline-test run via experiment alias.
- [`GET /v1/projects/{projectId}/issues`](/documentation/reference/api/v1/get-v1-projects-by-project-id-issues) — List issues.
- [`POST /v1/projects/{projectId}/issues`](/documentation/reference/api/v1/post-v1-projects-by-project-id-issues) — Create issue.
- [`GET /v1/projects/{projectId}/issues/{issueId}`](/documentation/reference/api/v1/get-v1-projects-by-project-id-issues-by-issue-id) — Get issue.
- [`PATCH /v1/projects/{projectId}/issues/{issueId}`](/documentation/reference/api/v1/patch-v1-projects-by-project-id-issues-by-issue-id) — Update issue.
- [`GET /v1/projects/{projectId}/judges`](/documentation/reference/api/v1/get-v1-projects-by-project-id-judges) — List judges.
- [`POST /v1/projects/{projectId}/judges`](/documentation/reference/api/v1/post-v1-projects-by-project-id-judges) — Create judge.
- [`PATCH /v1/projects/{projectId}/judges/{judgeId}`](/documentation/reference/api/v1/patch-v1-projects-by-project-id-judges-by-judge-id) — Update judge.
- [`DELETE /v1/projects/{projectId}/judges/{judgeId}`](/documentation/reference/api/v1/delete-v1-projects-by-project-id-judges-by-judge-id) — Delete judge.
- [`POST /v1/projects/{projectId}/judges/{judgeId}/action-groups`](/documentation/reference/api/v1/post-v1-projects-by-project-id-judges-by-judge-id-action-groups) — Set judge action groups.
- [`POST /v1/projects/{projectId}/judges/{judgeId}/lookup`](/documentation/reference/api/v1/post-v1-projects-by-project-id-judges-by-judge-id-lookup) — Get judge.
- [`PUT /v1/projects/{projectId}/judges/{judgeId}/versions/{judgeVersionId}/optimistic-eval`](/documentation/reference/api/v1/put-v1-projects-by-project-id-judges-by-judge-id-versions-by-judge-version-id-optimistic-eval) — Set judge version optimistic eval.
- [`PUT /v1/projects/{projectId}/judges/{judgeId}/versions/{judgeVersionId}/preprocessor-artifact-revision`](/documentation/reference/api/v1/put-v1-projects-by-project-id-judges-by-judge-id-versions-by-judge-version-id-preprocessor-artifact-revision) — Set judge version preprocessing artifact.
- [`GET /v1/projects/{projectId}/judges/action-groups`](/documentation/reference/api/v1/get-v1-projects-by-project-id-judges-action-groups) — List judge action groups.
- [`GET /v1/projects/{projectId}/memory/entries`](/documentation/reference/api/v1/get-v1-projects-by-project-id-memory-entries) — List memory entries.
- [`PUT /v1/projects/{projectId}/memory/files`](/documentation/reference/api/v1/put-v1-projects-by-project-id-memory-files) — Write a memory file.
- [`POST /v1/projects/{projectId}/memory/files/fetch`](/documentation/reference/api/v1/post-v1-projects-by-project-id-memory-files-fetch) — Fetch memory files.
- [`POST /v1/projects/{projectId}/memory/search`](/documentation/reference/api/v1/post-v1-projects-by-project-id-memory-search) — Search memory files.
- [`POST /v1/projects/{projectId}/prompts`](/documentation/reference/api/v1/post-v1-projects-by-project-id-prompts) — Insert prompt.
- [`GET /v1/projects/{projectId}/prompts/{name}`](/documentation/reference/api/v1/get-v1-projects-by-project-id-prompts-by-name) — Fetch prompt.
- [`POST /v1/projects/{projectId}/prompts/{name}/tags`](/documentation/reference/api/v1/post-v1-projects-by-project-id-prompts-by-name-tags) — Tag prompt.
- [`DELETE /v1/projects/{projectId}/prompts/{name}/tags`](/documentation/reference/api/v1/delete-v1-projects-by-project-id-prompts-by-name-tags) — Untag prompt.
- [`GET /v1/projects/{projectId}/prompts/{name}/versions`](/documentation/reference/api/v1/get-v1-projects-by-project-id-prompts-by-name-versions) — Get prompt versions.
- [`GET /v1/projects/{projectId}/scheduled-tasks`](/documentation/reference/api/v1/get-v1-projects-by-project-id-scheduled-tasks) — List scheduled tasks.
- [`POST /v1/projects/{projectId}/scheduled-tasks`](/documentation/reference/api/v1/post-v1-projects-by-project-id-scheduled-tasks) — Create a scheduled task.
- [`GET /v1/projects/{projectId}/scheduled-tasks/{taskId}`](/documentation/reference/api/v1/get-v1-projects-by-project-id-scheduled-tasks-by-task-id) — Get a scheduled task.
- [`PATCH /v1/projects/{projectId}/scheduled-tasks/{taskId}`](/documentation/reference/api/v1/patch-v1-projects-by-project-id-scheduled-tasks-by-task-id) — Update a scheduled task.
- [`GET /v1/projects/{projectId}/scorers`](/documentation/reference/api/v1/get-v1-projects-by-project-id-scorers) — Fetch scorers.
- [`GET /v1/projects/{projectId}/scorers/{name}/exists`](/documentation/reference/api/v1/get-v1-projects-by-project-id-scorers-by-name-exists) — Check if scorer exists.
- [`POST /v1/projects/{projectId}/scorers/custom`](/documentation/reference/api/v1/post-v1-projects-by-project-id-scorers-custom) — Upload custom scorer (deprecated).
- [`GET /v1/projects/{projectId}/scorers/custom/{name}/exists`](/documentation/reference/api/v1/get-v1-projects-by-project-id-scorers-custom-by-name-exists) — Check if custom scorer exists.
- [`POST /v1/projects/{projectId}/scorers/custom/bundle`](/documentation/reference/api/v1/post-v1-projects-by-project-id-scorers-custom-bundle) — Upload custom scorer bundle.
- [`POST /v1/projects/{projectId}/sql`](/documentation/reference/api/v1/post-v1-projects-by-project-id-sql) — Run a tenant-scoped virtual SQL query.
- [`GET /v1/projects/{projectId}/test-configs`](/documentation/reference/api/v1/get-v1-projects-by-project-id-test-configs) — Fetch test configs.
- [`POST /v1/projects/{projectId}/test-configs`](/documentation/reference/api/v1/post-v1-projects-by-project-id-test-configs) — Create test config.
- [`GET /v1/projects/{projectId}/test-configs/{testConfigId}`](/documentation/reference/api/v1/get-v1-projects-by-project-id-test-configs-by-test-config-id) — Fetch test config.
- [`PATCH /v1/projects/{projectId}/test-configs/{testConfigId}`](/documentation/reference/api/v1/patch-v1-projects-by-project-id-test-configs-by-test-config-id) — Update test config.
- [`DELETE /v1/projects/{projectId}/test-configs/{testConfigId}`](/documentation/reference/api/v1/delete-v1-projects-by-project-id-test-configs-by-test-config-id) — Delete test config.
- [`GET /v1/projects/{projectId}/test-runs`](/documentation/reference/api/v1/get-v1-projects-by-project-id-test-runs) — Fetch test runs.
- [`POST /v1/projects/{projectId}/test-runs`](/documentation/reference/api/v1/post-v1-projects-by-project-id-test-runs) — Prepare and queue test run.
- [`GET /v1/projects/{projectId}/test-runs/{testRunId}`](/documentation/reference/api/v1/get-v1-projects-by-project-id-test-runs-by-test-run-id) — Fetch test run.
- [`POST /v1/projects/{projectId}/test-runs/{testRunId}/cancel`](/documentation/reference/api/v1/post-v1-projects-by-project-id-test-runs-by-test-run-id-cancel) — Cancel test run.
- [`GET /v1/projects/{projectId}/test-runs/{testRunId}/graph`](/documentation/reference/api/v1/get-v1-projects-by-project-id-test-runs-by-test-run-id-graph) — Fetch test run graph.
- [`GET /v1/projects/{projectId}/test-runs/{testRunId}/items`](/documentation/reference/api/v1/get-v1-projects-by-project-id-test-runs-by-test-run-id-items) — Fetch test run items.
- [`GET /v1/projects/{projectId}/test-runs/{testRunId}/results`](/documentation/reference/api/v1/get-v1-projects-by-project-id-test-runs-by-test-run-id-results) — Fetch test run results.
- [`PATCH /v1/projects/{projectId}/test-runs/{testRunId}/status`](/documentation/reference/api/v1/patch-v1-projects-by-project-id-test-runs-by-test-run-id-status) — Update test run status.
- [`PATCH /v1/projects/{projectId}/test-runs/{testRunId}/success`](/documentation/reference/api/v1/patch-v1-projects-by-project-id-test-runs-by-test-run-id-success) — Apply test run pass-condition successes.
- [`POST /v1/projects/{projectId}/test-suites`](/documentation/reference/api/v1/post-v1-projects-by-project-id-test-suites) — Create a test suite.
- [`GET /v1/projects/{projectId}/test-suites`](/documentation/reference/api/v1/get-v1-projects-by-project-id-test-suites) — List test suites.
- [`DELETE /v1/projects/{projectId}/test-suites/{testSuiteId}`](/documentation/reference/api/v1/delete-v1-projects-by-project-id-test-suites-by-test-suite-id) — Delete a test suite with its runs.
- [`GET /v1/projects/{projectId}/test-suites/{testSuiteId}/cases`](/documentation/reference/api/v1/get-v1-projects-by-project-id-test-suites-by-test-suite-id-cases) — List test cases in a version or the draft.
- [`POST /v1/projects/{projectId}/test-suites/{testSuiteId}/cases`](/documentation/reference/api/v1/post-v1-projects-by-project-id-test-suites-by-test-suite-id-cases) — Add cases to a test suite's draft.
- [`PUT /v1/projects/{projectId}/test-suites/{testSuiteId}/cases/{caseId}`](/documentation/reference/api/v1/put-v1-projects-by-project-id-test-suites-by-test-suite-id-cases-by-case-id) — Replace a case in the draft.
- [`DELETE /v1/projects/{projectId}/test-suites/{testSuiteId}/cases/{caseId}`](/documentation/reference/api/v1/delete-v1-projects-by-project-id-test-suites-by-test-suite-id-cases-by-case-id) — Remove a case from the draft.
- [`POST /v1/projects/{projectId}/test-suites/{testSuiteId}/discard`](/documentation/reference/api/v1/post-v1-projects-by-project-id-test-suites-by-test-suite-id-discard) — Throw away the draft's changes.
- [`POST /v1/projects/{projectId}/test-suites/{testSuiteId}/draft`](/documentation/reference/api/v1/post-v1-projects-by-project-id-test-suites-by-test-suite-id-draft) — Copy the published cases into the draft to edit.
- [`POST /v1/projects/{projectId}/test-suites/{testSuiteId}/publish`](/documentation/reference/api/v1/post-v1-projects-by-project-id-test-suites-by-test-suite-id-publish) — Publish the draft as the next version.
- [`POST /v1/projects/{projectId}/test-suites/{testSuiteId}/runs`](/documentation/reference/api/v1/post-v1-projects-by-project-id-test-suites-by-test-suite-id-runs) — Start a test run.
- [`GET /v1/projects/{projectId}/test-suites/{testSuiteId}/runs`](/documentation/reference/api/v1/get-v1-projects-by-project-id-test-suites-by-test-suite-id-runs) — List test runs.
- [`GET /v1/projects/{projectId}/test-suites/runs/{runId}`](/documentation/reference/api/v1/get-v1-projects-by-project-id-test-suites-runs-by-run-id) — Get a test run.
- [`GET /v1/projects/{projectId}/test-suites/runs/{runId}/results`](/documentation/reference/api/v1/get-v1-projects-by-project-id-test-suites-runs-by-run-id-results) — Get test run results.
- [`POST /v1/projects/{projectId}/test-suites/runs/{runId}/score`](/documentation/reference/api/v1/post-v1-projects-by-project-id-test-suites-runs-by-run-id-score) — Score a test run.
- [`GET /v1/projects/{projectId}/trace-health/checks/{checkId}/traces`](/documentation/reference/api/v1/get-v1-projects-by-project-id-trace-health-checks-by-check-id-traces) — List traces failing a trace health check.
- [`GET /v1/projects/{projectId}/trace-health/summary`](/documentation/reference/api/v1/get-v1-projects-by-project-id-trace-health-summary) — Get trace health summary.
- [`GET /v1/projects/{projectId}/trace-health/traces/{traceId}`](/documentation/reference/api/v1/get-v1-projects-by-project-id-trace-health-traces-by-trace-id) — Get trace health for one trace.
- [`POST /v1/projects/{projectId}/traces/{traceId}/tags`](/documentation/reference/api/v1/post-v1-projects-by-project-id-traces-by-trace-id-tags) — Add trace tags.
- [`POST /v1/projects/{projectId}/traces/evaluate`](/documentation/reference/api/v1/post-v1-projects-by-project-id-traces-evaluate) — Evaluate stored traces.
- [`POST /v1/projects/{projectId}/traces/evaluate-all`](/documentation/reference/api/v1/post-v1-projects-by-project-id-traces-evaluate-all) — Evaluate recent traces.
- [`POST /v1/projects/resolve/`](/documentation/reference/api/v1/post-v1-projects-resolve) — Resolve project by name.
- [`GET /v1/projects/summaries`](/documentation/reference/api/v1/get-v1-projects-summaries) — List project summaries.
- [`GET /v1/sql/schema`](/documentation/reference/api/v1/get-v1-sql-schema) — Discover the virtual SQL schema.