Values.AutomatedReasoningPolicyFidelityReportSourceA comprehensive analysis report that measures how accurately a generated policy represents the source documents. The report includes coverage and accuracy scores, detailed grounding information linking policy elements to source statements, and annotated document content.
type nonrec t = {coverageScore : AutomatedReasoningPolicyCoverageScore.t option;A score from 0.0 to 1.0 indicating how well the policy covers the statements in the source documents. A higher score means more of the source content is represented in the policy.
*)accuracyScore : AutomatedReasoningPolicyAccuracyScore.t option;A score from 0.0 to 1.0 indicating how accurate the policy rules are relative to the source documents. A higher score means the policy rules more faithfully represent the source material.
*)ruleReports : AutomatedReasoningPolicyRuleReportMap.t option;A mapping from rule identifiers to detailed fidelity reports for each rule, showing which source statements ground each rule and how accurate it is.
*)variableReports : AutomatedReasoningPolicyVariableReportMap.t option;A mapping from variable names to detailed fidelity reports for each variable, showing which source statements ground each variable and how accurate it is.
*)documentSources : AutomatedReasoningPolicyReportSourceDocumentList.t option;A list of source documents with their content broken down into atomic statements and annotated with line numbers for precise referencing.
*)}val to_value :
t ->
[> `Structure of
(string
* [> `Double of AutomatedReasoningPolicyCoverageScore.t
| `List of
[> `Structure of
(string
* [> `List of
[> `Structure of
(string
* [> `Integer of Integer.t
| `List of
[> `Structure of
(string
* [> `Structure of
(string
* [> `Integer of Integer.t
| `String of
AutomatedReasoningPolicyLineText.t ])
list ])
list ]
list
| `String of
AutomatedReasoningPolicyStatementId.t
| `Structure of
(string
* [> `List of
[> `Integer of Integer.t ] list ])
list ])
list ]
list
| `String of AutomatedReasoningPolicyBuildDocumentName.t ])
list ]
list
| `Map of
([> `String of AutomatedReasoningPolicyDefinitionRuleId.t ]
* [> `Structure of
(string
* [> `Double of AutomatedReasoningPolicyAccuracyScore.t
| `List of
[> `String of
AutomatedReasoningPolicyJustificationText.t
| `Structure of
(string
* [> `String of
AutomatedReasoningPolicyDocumentId.t ])
list ]
list
| `String of AutomatedReasoningPolicyDefinitionRuleId.t ])
list ])
list ])
list ]