Skip to content

Fix documentation #16

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 3 commits into from
Jul 15, 2021
Merged

Fix documentation #16

Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
70a7d9f
Fix documentation
philschmid Jul 14, 2021
f50ddee
removed wrong line
philschmid Jul 14, 2021
d74ee54
updated versions
philschmid Jul 15, 2021
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
17 changes: 9 additions & 8 deletions README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -11,11 +11,11 @@

SageMaker Hugging Face Inference Toolkit is an open-source library for serving 🤗 Transformers models on Amazon SageMaker. This library provides default pre-processing, predict and postprocessing for certain 🤗 Transformers models and tasks. It utilizes the [SageMaker Inference Toolkit](https://github.com/aws/sagemaker-inference-toolkit) for starting up the model server, which is responsible for handling inference requests.

For Training, see [Run training on Amazon SageMaker](https://huggingface.co/transformers/sagemaker.html).
For Training, see [Run training on Amazon SageMaker](https://huggingface.co/docs/sagemaker/train).

For the Dockerfiles used for building SageMaker Hugging Face Containers, see [AWS Deep Learning Containers](https://github.com/aws/deep-learning-containers/tree/master/huggingface).

For information on running Hugging Face jobs on Amazon SageMaker, please refer to the [🤗 Transformers documentation](https://huggingface.co/transformers/sagemaker.html).
For information on running Hugging Face jobs on Amazon SageMaker, please refer to the [🤗 Transformers documentation](https://huggingface.co/docs/sagemaker).

For notebook examples: [SageMaker Notebook Examples](https://github.com/huggingface/notebooks/tree/master/sagemaker).

Expand All @@ -37,8 +37,9 @@ from sagemaker.huggingface import HuggingFaceModel

# create Hugging Face Model Class
huggingface_model = HuggingFaceModel(
transformers_version='4.4',
pytorch_version='1.6',
transformers_version='4.6',
pytorch_version='1.7',
py_version='py36',
model_data='s3://my-trained-model/artifcats/model.tar.gz',
role=role,
)
Expand All @@ -58,11 +59,11 @@ hub = {
}
# create Hugging Face Model Class
huggingface_model = HuggingFaceModel(
transformers_version='4.4',
pytorch_version='1.6',
transformers_version='4.6',
pytorch_version='1.7',
py_version='py36',
env=hub,
role=role,
name=hub['HF_MODEL_ID'],
)
# deploy model to SageMaker Inference
huggingface_model.deploy(initial_instance_count=1,instance_type="ml.m5.xlarge")
Expand Down Expand Up @@ -142,4 +143,4 @@ requests to us.
---
## 📜 License

SageMaker Hugging Face Inference Toolkit is licensed under the Apache 2.0 License.
SageMaker Hugging Face Inference Toolkit is licensed under the Apache 2.0 License.