File tree Expand file tree Collapse file tree 1 file changed +1
-4
lines changed Expand file tree Collapse file tree 1 file changed +1
-4
lines changed Original file line number Diff line number Diff line change @@ -74,10 +74,7 @@ type InferenceModelSpec struct {
74
74
ModelName string `json:"modelName"`
75
75
76
76
// Criticality defines how important it is to serve the model compared to other models referencing the same pool.
77
- // Criticality impacts how traffic is handled in resource constrained situations. It handles this by
78
- // queuing or rejecting requests of lower criticality. InferenceModels of an equivalent Criticality will
79
- // fairly share resources over throughput of tokens. In the future, the metric used to calculate fairness,
80
- // and the proportionality of fairness will be configurable.
77
+ // TODO: Update field upon resolution of: https://github.com/kubernetes-sigs/gateway-api-inference-extension/issues/213
81
78
//
82
79
// Default values for this field will not be set, to allow for future additions of new field that may 'one of' with this field.
83
80
// Any implementations that may consume this field may treat an unset value as the 'Standard' range.
You can’t perform that action at this time.
0 commit comments