Skip to content

Commit ba7eb81

Browse files
authored
Merge branch 'master' into updated_js_mb_compression_logic
2 parents a62da39 + f6ed99b commit ba7eb81

File tree

1 file changed

+11
-11
lines changed

1 file changed

+11
-11
lines changed

doc/overview.rst

+11-11
Original file line numberDiff line numberDiff line change
@@ -1034,7 +1034,7 @@ You can deploy the XGBoost model from the previous example to a SageMaker endpoi
10341034
initial_instance_count=1
10351035
)
10361036
1037-
For a sample notebook that demonstrates using ``ModelBuilder`` to build a XGBoost model, see `XGBoost example <https://github.com/aws-samples/sagemaker-hosting/SageMaker-Model-Builder/traditional-models/model-builder-xgboost.ipynb>`_.
1037+
For a sample notebook that demonstrates using ``ModelBuilder`` to build a XGBoost model, see `XGBoost example <https://github.com/aws-samples/sagemaker-hosting/blob/main/SageMaker-Model-Builder/traditional-models/model-builder-xgboost.ipynb>`_.
10381038

10391039
**Triton models**.
10401040
You can use ``ModelBuilder`` to serve PyTorch models on a Triton inference server. Specify the ``model_server`` parameter as ``ModelServer.TRITON``, pass a model, and include a ``SchemaBuilder`` object which requires sample inputs and outputs from the model. The following snippet shows an example.
@@ -1056,7 +1056,7 @@ You can use ``ModelBuilder`` to serve PyTorch models on a Triton inference serve
10561056
initial_instance_count=1
10571057
)
10581058
1059-
For a sample notebook that demonstrates using ``ModelBuilder`` to build a Triton model, see `Triton example <https://github.com/aws-samples/sagemaker-hosting/SageMaker-Model-Builder/traditional-models/model-builder-triton.ipynb>`_.
1059+
For a sample notebook that demonstrates using ``ModelBuilder`` to build a Triton model, see `Triton example <https://github.com/aws-samples/sagemaker-hosting/blob/main/SageMaker-Model-Builder/traditional-models/model-builder-triton.ipynb>`_.
10601060

10611061

10621062
**Hugging Face models**.
@@ -1101,7 +1101,7 @@ Create the ``ModelBuilder`` object and deploy the model onto a SageMaker endpoin
11011101
instance_type='ml.g5.2xlarge'
11021102
)
11031103
1104-
For a sample notebook that demonstrates using ``ModelBuilder`` to build a Hugging Face model, see `Hugging Face example <https://github.com/aws-samples/sagemaker-hosting/SageMaker-Model-Builder/traditional-models/model-builder-huggingface.ipynb>`_.
1104+
For a sample notebook that demonstrates using ``ModelBuilder`` to build a Hugging Face model, see `Hugging Face example <https://github.com/aws-samples/sagemaker-hosting/blob/main/SageMaker-Model-Builder/traditional-models/model-builder-huggingface.ipynb>`_.
11051105

11061106

11071107
Deploy foundation models to SageMaker Endpoints
@@ -1135,7 +1135,7 @@ For gated models on Hugging Face Hub, request access and pass the associated key
11351135

11361136
A feature of ``ModelBuilder`` is the ability to run local tuning on the container when you use `LOCAL_CONTAINER` mode. In this case ``ModelBuilder`` tunes the parameter(s) for the underlying model server. This feature can be used by executing `tuned_model=model.tune()`. Before running `tune`, clean up other containers running locally or else you might see an "address already in use" error.
11371137

1138-
For a sample notebook that demonstrates using ``ModelBuilder`` to build a Hugging Face Hub model, see `Hugging Face Hub example <https://github.com/aws-samples/sagemaker-hosting/SageMaker-Model-Builder/model-builder-huggingface-llama2.ipynb>`_.
1138+
For a sample notebook that demonstrates using ``ModelBuilder`` to build a Hugging Face Hub model, see `Hugging Face Hub example <https://github.com/aws-samples/sagemaker-hosting/blob/main/SageMaker-Model-Builder/model-builder-huggingface-llama2.ipynb>`_.
11391139

11401140

11411141
**JumpStart**. JumpStart also offers a number of pre-trained foundation models. Again, the model ID is required. Deploying a JumpStart model to a SageMaker endpoint is straightforward, as shown in the following example:
@@ -1154,24 +1154,24 @@ For a sample notebook that demonstrates using ``ModelBuilder`` to build a Huggin
11541154
11551155
For a list of available JumpStart model IDs, see `Built-in Algorithms with pre-trained Model Table <https://sagemaker.readthedocs.io/en/stable/doc_utils/pretrainedmodels.html>`_.
11561156

1157-
For a sample notebook that demonstrates using ``ModelBuilder`` to build a JumpStart model, see `JumpStart example <https://github.com/aws-samples/sagemaker-hosting/SageMaker-Model-Builder/foundation-models/model-builder-jumpstart-falcon.ipynb>`_.
1157+
For a sample notebook that demonstrates using ``ModelBuilder`` to build a JumpStart model, see `JumpStart example <https://github.com/aws-samples/sagemaker-hosting/blob/main/SageMaker-Model-Builder/foundation-models/model-builder-jumpstart-falcon.ipynb>`_.
11581158

11591159
ModelBuilder examples
11601160
^^^^^^^^^^^^^^^^^^^^^
11611161

11621162
For example notebooks that demonstrate the use of ``ModelBuilder`` and its supporting classes, as well as model creation of traditional and foundation models, see the following links:
11631163

1164-
* `Pytorch example <https://github.com/aws-samples/sagemaker-hosting/SageMaker-Model-Builder/traditional-models/model-builder-pytorch.ipynb>`_
1164+
* `Pytorch example <https://github.com/aws-samples/sagemaker-hosting/blob/main/SageMaker-Model-Builder/traditional-models/model-builder-pytorch.ipynb>`__
11651165

1166-
* `XGBoost example <https://github.com/aws-samples/sagemaker-hosting/SageMaker-Model-Builder/traditional-models/model-builder-xgboost.ipynb>`_
1166+
* `XGBoost example <https://github.com/aws-samples/sagemaker-hosting/blob/main/SageMaker-Model-Builder/traditional-models/model-builder-xgboost.ipynb>`__
11671167

1168-
* `Triton example <https://github.com/aws-samples/sagemaker-hosting/SageMaker-Model-Builder/traditional-models/model-builder-triton.ipynb>`_
1168+
* `Triton example <https://github.com/aws-samples/sagemaker-hosting/blob/main/SageMaker-Model-Builder/traditional-models/model-builder-triton.ipynb>`__
11691169

1170-
* `Hugging Face example <https://github.com/aws-samples/sagemaker-hosting/SageMaker-Model-Builder/traditional-models/model-builder-huggingface.ipynb>`_
1170+
* `Hugging Face example <https://github.com/aws-samples/sagemaker-hosting/blob/main/SageMaker-Model-Builder/traditional-models/model-builder-huggingface.ipynb>`__
11711171

1172-
* `Hugging Face Hub example <https://github.com/aws-samples/sagemaker-hosting/SageMaker-Model-Builder/model-builder-huggingface-llama2.ipynb>`_
1172+
* `Hugging Face Hub example <https://github.com/aws-samples/sagemaker-hosting/blob/main/SageMaker-Model-Builder/foundation-models/model-builder-huggingface-llama2.ipynb>`__
11731173

1174-
* `JumpStart example <https://github.com/aws-samples/sagemaker-hosting/SageMaker-Model-Builder/foundation-models/model-builder-jumpstart-falcon.ipynb>`_
1174+
* `JumpStart example <https://github.com/aws-samples/sagemaker-hosting/blob/main/SageMaker-Model-Builder/foundation-models/model-builder-jumpstart-falcon.ipynb>`__
11751175

11761176

11771177
Fine-tune a Model and Deploy to a SageMaker Endpoint

0 commit comments

Comments
 (0)