---
title: Testing
seo:
  title: Testing — Python SDK
  description: >-
    Test suites: versioned test cases scored by judges against your agent's
    traces. (Python SDK)
description: >-
  Test suites: versioned test cases scored by judges against your agent's
  traces.
---

A test suite holds cases. Each case has an `input` for your agent and an
`expected` mapping that names the judges to run on the case's trace and
what each judge's output must compare to. Edit cases in the suite's draft,
publish a version, then start runs against it.

**[StartedCase](/sdk-reference/python/testing/StartedCase)**

**[StartedRun](/sdk-reference/python/testing/StartedRun)**

**[RunSummary](/sdk-reference/python/testing/RunSummary)**

**[CheckResult](/sdk-reference/python/testing/CheckResult)**

**[CaseResult](/sdk-reference/python/testing/CaseResult)**

**[RunResults](/sdk-reference/python/testing/RunResults)**

**[TestSuitesFactory](/sdk-reference/python/testing/TestSuitesFactory)**

**[TestRunsFactory](/sdk-reference/python/testing/TestRunsFactory)**