Sdk referenceTypescript
EvaluationRunOptions
Properties
examples
:Example[]
The examples to evaluate.
scorers
:string[] | Judge<BaseResponse>[]
Hosted scorer names (strings like "faithfulness") or
custom Judge instances. Cannot mix both.
evalRunName
:string
A name for this run, visible in the dashboard.
assertTest
:boolean | undefined
If true, throws an error when any scorer fails its threshold. Useful in CI/CD pipelines.
timeoutSeconds
:number | undefined
Maximum seconds to wait for hosted scorer results before timing out.
Last updated on