LocalEvaluatorRunner
Evaluation runner for custom (in-process) scorers.
Runs all Judge instances locally against the provided examples, posts results to the Judgment platform, then polls for finalized scores. Used internally by Evaluation.
Evaluation runner for custom (in-process) scorers.
Runs all Judge instances locally against the provided examples, posts results to the Judgment platform, then polls for finalized scores. Used internally by Evaluation.
Was this page helpful?
Thanks for your feedback!