EvaluationFactory
Creates Evaluation instances for running batch scoring. Access via `client.evaluation`.
Creates Evaluation instances for running batch scoring.
Access via client.evaluation.
const evaluation = client.evaluation.create();
const results = await evaluation.run({ examples, scorers, evalRunName: "my-eval" });create()
Create a new Evaluation bound to the current project.
function create(): EvaluationReturns
Evaluation
Evaluation
Score a batch of examples using hosted scorers or custom judges. Two modes are supported: - **Hosted scorers** — pass scorer names as strings (e.g. `"faithfulness"`, `"answer_relevancy"`). Evaluation runs server-side on the Judgment platform. - **Custom judges** — pass Judge subclass instances for in-process evaluation with your own scoring logic. Create an `Evaluation` via `client.evaluation.create()`, then call `.run()` to execute scorers against your examples.
EvaluationRunOptions
Next Page
Last updated on