Skip to content

Commit 22fc22a

Browse files
committed
sm model parallel 1.8.0 release notes
1 parent acadfd3 commit 22fc22a

File tree

3 files changed

+44
-10
lines changed

3 files changed

+44
-10
lines changed

doc/api/training/distributed.rst

+2-2
Original file line numberDiff line numberDiff line change
@@ -10,7 +10,7 @@ The SageMaker Distributed Data Parallel Library
1010
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
1111

1212
.. toctree::
13-
:maxdepth: 3
13+
:maxdepth: 2
1414

1515
smd_data_parallel
1616
sdp_versions/latest
@@ -23,7 +23,7 @@ The SageMaker Distributed Model Parallel Library
2323
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
2424

2525
.. toctree::
26-
:maxdepth: 3
26+
:maxdepth: 2
2727

2828
smd_model_parallel
2929
smp_versions/latest

doc/api/training/smd_model_parallel_release_notes/smd_model_parallel_change_log.rst

+40-6
Original file line numberDiff line numberDiff line change
@@ -5,9 +5,48 @@ Release Notes
55
New features, bug fixes, and improvements are regularly made to the SageMaker
66
distributed model parallel library.
77

8-
SageMaker Distributed Model Parallel 1.7.0 Release Notes
8+
SageMaker Distributed Model Parallel 1.8.0 Release Notes
99
========================================================
1010

11+
*Date: March. 23. 2022*
12+
13+
**New Features**
14+
15+
* Added tensor parallelism support for the `GPT-J model
16+
<https://huggingface.co/docs/transformers/model_doc/gptj>`_.
17+
When using the GPT-J model of Hugging Face Transformers v4.17.0 with
18+
tensor parallelism, the SageMaker model parallel library automatically
19+
replaces the model with a tensor parallel distributed GPT-J model.
20+
For more information, see `Support for Hugging Face Transformer Models
21+
<https://docs.aws.amazon.com/sagemaker/latest/dg/model-parallel-extended-features-pytorch-hugging-face.html>`_
22+
in the *Amazon SageMaker Model Parallel Training developer guide*.
23+
24+
**Migration to AWS Deep Learning Containers**
25+
26+
This version passed benchmark testing and is migrated to the following AWS Deep Learning Containers:
27+
28+
* HuggingFace 4.17.0 DLC with PyTorch 1.10.2
29+
30+
.. code::
31+
32+
763104351884.dkr.ecr.us-west-2.amazonaws.com/huggingface-pytorch-training:1.10.2-transformers4.17.0-gpu-py38-cu113-ubuntu20.04
33+
34+
35+
The binary file of this version of the library for custom container users:
36+
37+
.. code::
38+
39+
https://sagemaker-distributed-model-parallel.s3.us-west-2.amazonaws.com/pytorch-1.10.0/build-artifacts/2022-03-12-00-33/smdistributed_modelparallel-1.8.0-cp38-cp38-linux_x86_64.whl
40+
41+
42+
----
43+
44+
Release History
45+
===============
46+
47+
SageMaker Distributed Model Parallel 1.7.0 Release Notes
48+
--------------------------------------------------------
49+
1150
*Date: March. 07. 2022*
1251

1352
**Currency Updates**
@@ -49,11 +88,6 @@ This version passed benchmark testing and is migrated to the following AWS Deep
4988
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training:1.10.2-gpu-py38-cu113-ubuntu20.04-sagemaker
5089
5190
52-
----
53-
54-
Release History
55-
===============
56-
5791
SageMaker Distributed Model Parallel 1.6.0 Release Notes
5892
--------------------------------------------------------
5993

doc/api/training/smp_versions/latest.rst

+2-2
Original file line numberDiff line numberDiff line change
@@ -10,8 +10,8 @@ depending on which version of the library you need to use.
1010
To use the library, reference the
1111
**Common API** documentation alongside the framework specific API documentation.
1212

13-
Version 1.7.0 (Latest)
14-
======================
13+
Version 1.7.0, 1.8.0 (Latest)
14+
=============================
1515

1616
To use the library, reference the Common API documentation alongside the framework specific API documentation.
1717

0 commit comments

Comments
 (0)