Skip to content

Commit 4c8b86b

Browse files
author
AWS
committed
Amazon SageMaker Service Update: Release new parameter CapacityReservationConfig in ProductionVariant
1 parent 087a387 commit 4c8b86b

File tree

2 files changed

+99
-0
lines changed

2 files changed

+99
-0
lines changed
Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,6 @@
1+
{
2+
"type": "feature",
3+
"category": "Amazon SageMaker Service",
4+
"contributor": "",
5+
"description": "Release new parameter CapacityReservationConfig in ProductionVariant"
6+
}

services/sagemaker/src/main/resources/codegen-resources/service-2.json

Lines changed: 93 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -7023,6 +7023,10 @@
70237023
},
70247024
"documentation":"<p>The SageMaker Canvas application settings.</p>"
70257025
},
7026+
"CapacityReservationPreference":{
7027+
"type":"string",
7028+
"enum":["capacity-reservations-only"]
7029+
},
70267030
"CapacitySize":{
70277031
"type":"structure",
70287032
"required":[
@@ -19326,6 +19330,33 @@
1932619330
},
1932719331
"documentation":"<p>A collection of EBS storage settings that apply to both private and shared spaces.</p>"
1932819332
},
19333+
"Ec2CapacityReservation":{
19334+
"type":"structure",
19335+
"members":{
19336+
"Ec2CapacityReservationId":{
19337+
"shape":"Ec2CapacityReservationId",
19338+
"documentation":"<p>The unique identifier for an EC2 capacity reservation that's part of the ML capacity reservation.</p>"
19339+
},
19340+
"TotalInstanceCount":{
19341+
"shape":"TaskCount",
19342+
"documentation":"<p>The number of instances that you allocated to the EC2 capacity reservation.</p>"
19343+
},
19344+
"AvailableInstanceCount":{
19345+
"shape":"TaskCount",
19346+
"documentation":"<p>The number of instances that are currently available in the EC2 capacity reservation.</p>"
19347+
},
19348+
"UsedByCurrentEndpoint":{
19349+
"shape":"TaskCount",
19350+
"documentation":"<p>The number of instances from the EC2 capacity reservation that are being used by the endpoint.</p>"
19351+
}
19352+
},
19353+
"documentation":"<p>The EC2 capacity reservations that are shared to an ML capacity reservation.</p>"
19354+
},
19355+
"Ec2CapacityReservationId":{"type":"string"},
19356+
"Ec2CapacityReservationsList":{
19357+
"type":"list",
19358+
"member":{"shape":"Ec2CapacityReservation"}
19359+
},
1932919360
"Edge":{
1933019361
"type":"structure",
1933119362
"members":{
@@ -29342,6 +29373,12 @@
2934229373
"min":0,
2934329374
"pattern":"1|2"
2934429375
},
29376+
"MlReservationArn":{
29377+
"type":"string",
29378+
"max":258,
29379+
"min":20,
29380+
"pattern":"arn:aws[a-z\\-]*:sagemaker:[a-z0-9\\-]*:[0-9]{12}:ml-reservation/.*"
29381+
},
2934529382
"MlTools":{
2934629383
"type":"string",
2934729384
"enum":[
@@ -34305,6 +34342,10 @@
3430534342
"InferenceAmiVersion":{
3430634343
"shape":"ProductionVariantInferenceAmiVersion",
3430734344
"documentation":"<p>Specifies an option from a collection of preconfigured Amazon Machine Image (AMI) images. Each image is configured by Amazon Web Services with a set of software and driver versions. Amazon Web Services optimizes these configurations for different machine learning workloads.</p> <p>By selecting an AMI version, you can ensure that your inference environment is compatible with specific software requirements, such as CUDA driver versions, Linux kernel versions, or Amazon Web Services Neuron driver versions.</p> <p>The AMI version names, and their configurations, are the following:</p> <dl> <dt>al2-ami-sagemaker-inference-gpu-2</dt> <dd> <ul> <li> <p>Accelerator: GPU</p> </li> <li> <p>NVIDIA driver version: 535</p> </li> <li> <p>CUDA version: 12.2</p> </li> </ul> </dd> <dt>al2-ami-sagemaker-inference-gpu-2-1</dt> <dd> <ul> <li> <p>Accelerator: GPU</p> </li> <li> <p>NVIDIA driver version: 535</p> </li> <li> <p>CUDA version: 12.2</p> </li> <li> <p>NVIDIA Container Toolkit with disabled CUDA-compat mounting</p> </li> </ul> </dd> <dt>al2-ami-sagemaker-inference-gpu-3-1</dt> <dd> <ul> <li> <p>Accelerator: GPU</p> </li> <li> <p>NVIDIA driver version: 550</p> </li> <li> <p>CUDA version: 12.4</p> </li> <li> <p>NVIDIA Container Toolkit with disabled CUDA-compat mounting</p> </li> </ul> </dd> <dt>al2-ami-sagemaker-inference-neuron-2</dt> <dd> <ul> <li> <p>Accelerator: Inferentia2 and Trainium</p> </li> <li> <p>Neuron driver version: 2.19</p> </li> </ul> </dd> </dl>"
34345+
},
34346+
"CapacityReservationConfig":{
34347+
"shape":"ProductionVariantCapacityReservationConfig",
34348+
"documentation":"<p>Settings for the capacity reservation for the compute instances that SageMaker AI reserves for an endpoint. </p>"
3430834349
}
3430934350
},
3431034351
"documentation":"<p> Identifies a model that you want to host and the resources chosen to deploy for hosting it. If you are deploying multiple models, tell SageMaker how to distribute traffic among the models by specifying variant weights. For more information on production variants, check <a href=\"https://docs.aws.amazon.com/sagemaker/latest/dg/model-ab-testing.html\"> Production variants</a>. </p>"
@@ -34320,6 +34361,50 @@
3432034361
"ml.eia2.xlarge"
3432134362
]
3432234363
},
34364+
"ProductionVariantCapacityReservationConfig":{
34365+
"type":"structure",
34366+
"members":{
34367+
"CapacityReservationPreference":{
34368+
"shape":"CapacityReservationPreference",
34369+
"documentation":"<p>Options that you can choose for the capacity reservation. SageMaker AI supports the following options:</p> <dl> <dt>capacity-reservations-only</dt> <dd> <p>SageMaker AI launches instances only into an ML capacity reservation. If no capacity is available, the instances fail to launch.</p> </dd> </dl>"
34370+
},
34371+
"MlReservationArn":{
34372+
"shape":"MlReservationArn",
34373+
"documentation":"<p>The Amazon Resource Name (ARN) that uniquely identifies the ML capacity reservation that SageMaker AI applies when it deploys the endpoint.</p>"
34374+
}
34375+
},
34376+
"documentation":"<p>Settings for the capacity reservation for the compute instances that SageMaker AI reserves for an endpoint. </p>"
34377+
},
34378+
"ProductionVariantCapacityReservationSummary":{
34379+
"type":"structure",
34380+
"members":{
34381+
"MlReservationArn":{
34382+
"shape":"MlReservationArn",
34383+
"documentation":"<p>The Amazon Resource Name (ARN) that uniquely identifies the ML capacity reservation that SageMaker AI applies when it deploys the endpoint.</p>"
34384+
},
34385+
"CapacityReservationPreference":{
34386+
"shape":"CapacityReservationPreference",
34387+
"documentation":"<p>The option that you chose for the capacity reservation. SageMaker AI supports the following options:</p> <dl> <dt>capacity-reservations-only</dt> <dd> <p>SageMaker AI launches instances only into an ML capacity reservation. If no capacity is available, the instances fail to launch.</p> </dd> </dl>"
34388+
},
34389+
"TotalInstanceCount":{
34390+
"shape":"TaskCount",
34391+
"documentation":"<p>The number of instances that you allocated to the ML capacity reservation.</p>"
34392+
},
34393+
"AvailableInstanceCount":{
34394+
"shape":"TaskCount",
34395+
"documentation":"<p>The number of instances that are currently available in the ML capacity reservation.</p>"
34396+
},
34397+
"UsedByCurrentEndpoint":{
34398+
"shape":"TaskCount",
34399+
"documentation":"<p>The number of instances from the ML capacity reservation that are being used by the endpoint.</p>"
34400+
},
34401+
"Ec2CapacityReservations":{
34402+
"shape":"Ec2CapacityReservationsList",
34403+
"documentation":"<p>The EC2 capacity reservations that are shared to this ML capacity reservation, if any.</p>"
34404+
}
34405+
},
34406+
"documentation":"<p>Details about an ML capacity reservation.</p>"
34407+
},
3432334408
"ProductionVariantContainerStartupHealthCheckTimeoutInSeconds":{
3432434409
"type":"integer",
3432534410
"box":true,
@@ -34732,6 +34817,10 @@
3473234817
"RoutingConfig":{
3473334818
"shape":"ProductionVariantRoutingConfig",
3473434819
"documentation":"<p>Settings that control how the endpoint routes incoming traffic to the instances that the endpoint hosts.</p>"
34820+
},
34821+
"CapacityReservationConfig":{
34822+
"shape":"ProductionVariantCapacityReservationSummary",
34823+
"documentation":"<p>Settings for the capacity reservation for the compute instances that SageMaker AI reserves for an endpoint. </p>"
3473534824
}
3473634825
},
3473734826
"documentation":"<p>Describes weight and capacities for a production variant associated with an endpoint. If you sent a request to the <code>UpdateEndpointWeightsAndCapacities</code> API and the endpoint status is <code>Updating</code>, you get different desired and current values. </p>"
@@ -41161,6 +41250,10 @@
4116141250
"ProjectS3Path":{
4116241251
"shape":"S3Uri",
4116341252
"documentation":"<p>The location where Amazon S3 stores temporary execution data and other artifacts for the project that corresponds to the domain.</p>"
41253+
},
41254+
"SingleSignOnApplicationArn":{
41255+
"shape":"SingleSignOnApplicationArn",
41256+
"documentation":"<p>The ARN of the application managed by SageMaker AI and SageMaker Unified Studio in the Amazon Web Services IAM Identity Center.</p>"
4116441257
}
4116541258
},
4116641259
"documentation":"<p>The settings that apply to an Amazon SageMaker AI domain when you use it in Amazon SageMaker Unified Studio.</p>"

0 commit comments

Comments
 (0)