Module Policy.Make

Parameters

module AD : Owl_algodiff_generic_sig.Sig

Signature

val row : AD.A.arr -> int -> AD.A.arr

Row i of a matrix, as a vector.

val categorical : (AD.t, AD.A.arr, int) t

The output is logits; samples are one-hot.

val gaussian : low:float array -> high:float array -> (AD.t, AD.A.arr, AD.A.arr) t

The output is [mean_1 .. mean_d; log_std_1 .. log_std_d]; log_std is bounded to [-5, 2]. Actions are clipped to [low, high]. Raises Invalid_argument unless low < high element-wise.