doc: pytorch serving eia #52
Conversation
AWS CodeBuild CI Report
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository |
README.rst
Outdated
| * For information on how Amazon Elastic Inference works, see `How EI Works <https://docs.aws.amazon.com/sagemaker/latest/dg/ei.html#ei-how-it-works>`__. | ||
| * For more information in regards to using Amazon Elastic Inference in SageMaker, see `Amazon SageMaker Elastic Inference <https://docs.aws.amazon.com/sagemaker/latest/dg/ei.html>`__. | ||
|
|
||
| Building the SageMaker Elastic Inference MXNet Serving container |
AWS CodeBuild CI Report
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository |
| @@ -25,6 +25,7 @@ Table of Contents | |||
|
|
|||
| #. `Getting Started <#getting-started>`__ | |||
| #. `Building your Image <#building-your-image>`__ | |||
| #. `Amazon Elastic Inference with PyTorch in SageMaker <#elastic-inference>`__ | |||
There was a problem hiding this comment.
#elastic-inference doesn't work as a link. It should be #amazon-elastic-inference-with-pytorch-in-sagemaker
|
|
||
| Building the SageMaker Elastic Inference PyTorch Serving container | ||
| ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | ||
| Amazon Elastic Inference is designed to be used with AWS enhanced versions of TensorFlow serving, Apache MXNet or PyTorch serving. |
| `Amazon Elastic Inference <https://aws.amazon.com/machine-learning/elastic-inference/>`__ allows you to to attach | ||
| low-cost GPU-powered acceleration to Amazon EC2 and Amazon SageMaker instances to reduce the cost of running deep | ||
| learning inference by up to 75%. Currently, Amazon Elastic Inference supports TensorFlow, Apache MXNet, PyTorch, | ||
| and ONNX models, with more frameworks coming soon. |
There was a problem hiding this comment.
"with more frameworks coming soon"...if this was originally intended to refer to PyTorch, maybe it should be removed now.
| ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | ||
| Amazon Elastic Inference is designed to be used with AWS enhanced versions of TensorFlow serving, Apache MXNet or PyTorch serving. | ||
| The SageMaker PyTorch containers with Amazon Elastic Inference support were built utilizing the | ||
| same instructions listed `above <https://github.com/aws/sagemaker-pytorch-serving-container#building-your-image>`__ with the |
There was a problem hiding this comment.
nit: Should this link just be above <#building-your-image> like in table of contents?
AWS CodeBuild CI Report
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository |
chuyang-deng
changed the title
AWS CodeBuild CI Report
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository |
AWS CodeBuild CI Report
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository |
AWS CodeBuild CI Report
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository |
|
closing for #55 |
Issue #, if available:
Description of changes:
add pytorch serving eia related doc
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.