EvaluationFactory

Creates Evaluation instances for running batch scoring.

Access this via client.evaluation -- you don't instantiate it directly.

evaluation = client.evaluation.create()
results = evaluation.run(
    examples=examples,
    scorers=["faithfulness"],
    eval_run_name="nightly",
)

__init__()

def __init__(client, project_id, project_name):

Parameters

create()

Create a new Evaluation bound to the current project.

def create() -> Evaluation:

Returns

Evaluation - An Evaluation instance ready for .run().