OfflineRunOptions

Options accepted by OfflineTestRunner.run.

Properties

PropType

agentFunction?AgentFunction | undefined

TypeAgentFunction | undefined

judgeVersions?JudgeVersionPin[] | undefined

TypeJudgeVersionPin[] | undefined

datasetVersion?string | number | undefined

Typestring | number | undefined

passConditionFn?PassConditionFn | undefined

TypePassConditionFn | undefined

assertTest?boolean | undefined

Typeboolean | undefined

timeoutSeconds?number | undefined

Typenumber | undefined

runName?string | undefined

Optional display name for the run; server auto-names it when omitted.

Typestring | undefined

concurrency?number | undefined

Maximum number of examples the agent runs over at a time. Defaults to 1 (sequential, in dataset order). Only affects the agent execution loop; judge scoring happens server-side and is unaffected.

Typenumber | undefined