Values.AutomatedEvaluationCustomMetricConfigSourceDefines the configuration of custom metrics to be used in an evaluation job. To learn more about using custom metrics in Amazon Bedrock evaluation jobs, see Create a prompt for a custom metrics (LLM-as-a-judge model evaluations) and Create a prompt for a custom metrics (RAG evaluations).
type nonrec t = {customMetrics : AutomatedEvaluationCustomMetrics.t;Defines a list of custom metrics to be used in an Amazon Bedrock evaluation job.
*)evaluatorModelConfig : CustomMetricEvaluatorModelConfig.t;Configuration of the evaluator model you want to use to evaluate custom metrics in an Amazon Bedrock evaluation job.
*)}val make :
customMetrics:AutomatedEvaluationCustomMetrics.t ->
evaluatorModelConfig:CustomMetricEvaluatorModelConfig.t ->
unit ->
tval to_value :
t ->
[> `Structure of
(string
* [> `List of
[> `Structure of
(string
* [> `Structure of
(string
* [> `List of
[> `Structure of
(string
* [> `String of
RatingScaleItemDefinition.t
| `Structure of
(string
* [> `Float of Float_.t
| `String of
RatingScaleItemValueStringValueString.t ])
list ])
list ]
list
| `String of MetricName.t ])
list ])
list ]
list
| `Structure of
(string
* [> `List of
[> `Structure of
(string * [> `String of EvaluatorModelIdentifier.t ])
list ]
list ])
list ])
list ]