Values_1.InferenceComponentSchedulingConfigSourceThe scheduling configuration that determines how inference component copies are placed across available instances when copies are added or removed.
type nonrec t = {placementStrategy : InferenceComponentPlacementStrategy.t;The strategy for placing inference component copies across available instances. If you also set AvailabilityZoneBalance, this strategy applies to placement within each Availability Zone. SPREAD Distributes copies evenly across available instances for better resilience. BINPACK Packs copies onto fewer instances to optimize resource utilization.
*)availabilityZoneBalance : InferenceComponentAvailabilityZoneBalance.t option;Configuration for balancing inference component copies across Availability Zones.
*)}val make :
?availabilityZoneBalance:??? ->
placementStrategy:InferenceComponentPlacementStrategy.t ->
unit ->
tval to_value :
t ->
[> `Structure of
(string
* [> `Enum of string
| `Structure of
(string
* [> `Enum of string
| `Integer of Values_0.AvailabilityZoneBalanceMaxImbalance.t ])
list ])
list ]