Module Values.HumanEvaluationCustomMetricSource

In a model evaluation job that uses human workers you must define the name of the metric, and how you want that metric rated ratingMethod, and an optional description of the metric.

Sourcetype nonrec t = {
  1. name : EvaluationMetricName.t;
    (*

    The name of the metric. Your human evaluators will see this name in the evaluation UI.

    *)
  2. description : EvaluationMetricDescription.t option;
    (*

    An optional description of the metric. Use this parameter to provide more details about the metric.

    *)
  3. ratingMethod : EvaluationRatingMethod.t;
    (*

    Choose how you want your human workers to evaluation your model. Valid values for rating methods are ThumbsUpDown, IndividualLikertScale,ComparisonLikertScale, ComparisonChoice, and ComparisonRank

    *)
}
Sourceval context_ : string
Sourceval make : ?description:??? -> name:EvaluationMetricName.t -> ratingMethod:EvaluationRatingMethod.t -> unit -> t
Sourceval to_value : t -> [> `Structure of (string * [> `String of EvaluationMetricName.t ]) list ]
Sourceval to_query : t -> Awso.Client.Query.t
Sourceval of_xml : Awso.Xml.t -> t
Sourceval of_string : string -> t
Sourceval of_json : Yojson.Safe.t -> t
Sourceval to_json : t -> Yojson.Safe.t