APIScorerConfig

For reference only - users should create scorers via ExampleScorer instead of implementing APIScorerConfig directly

Configuration object for built-in Judgment scorers.

namerequired:str

Unique identifier for the scorer configuration

Example: "accuracy_scorer"

promptrequired:str

The evaluation prompt that will be used to judge responses

Example:

"Rate the accuracy of this answer on a scale of 1-5, where 5 is completely accurate."

options:Dict[str, Any]

Additional configuration options for the scorer

Example:

{
  "model": "gpt-4",
  "temperature": 0.0,
  "max_tokens": 100
}

judgment_api_key:str

API key for Judgment platform authentication. Defaults to JUDGMENT_API_KEY environment variable

organization_id:str

Organization identifier for API requests. Defaults to JUDGMENT_ORG_ID environment variable