@@ -5,9 +5,48 @@ Release Notes
5
5
New features, bug fixes, and improvements are regularly made to the SageMaker
6
6
distributed model parallel library.
7
7
8
- SageMaker Distributed Model Parallel 1.7 .0 Release Notes
8
+ SageMaker Distributed Model Parallel 1.8 .0 Release Notes
9
9
========================================================
10
10
11
+ *Date: March. 23. 2022 *
12
+
13
+ **New Features **
14
+
15
+ * Added tensor parallelism support for the `GPT-J model
16
+ <https://huggingface.co/docs/transformers/model_doc/gptj> `_.
17
+ When using the GPT-J model of Hugging Face Transformers v4.17.0 with
18
+ tensor parallelism, the SageMaker model parallel library automatically
19
+ replaces the model with a tensor parallel distributed GPT-J model.
20
+ For more information, see `Support for Hugging Face Transformer Models
21
+ <https://docs.aws.amazon.com/sagemaker/latest/dg/model-parallel-extended-features-pytorch-hugging-face.html> `_
22
+ in the *Amazon SageMaker Model Parallel Training developer guide *.
23
+
24
+ **Migration to AWS Deep Learning Containers **
25
+
26
+ This version passed benchmark testing and is migrated to the following AWS Deep Learning Containers:
27
+
28
+ * HuggingFace 4.17.0 DLC with PyTorch 1.10.2
29
+
30
+ .. code ::
31
+
32
+ 763104351884.dkr.ecr.us-west-2.amazonaws.com/huggingface-pytorch-training:1.10.2-transformers4.17.0-gpu-py38-cu113-ubuntu20.04
33
+
34
+
35
+ The binary file of this version of the library for custom container users:
36
+
37
+ .. code ::
38
+
39
+ https://sagemaker-distributed-model-parallel.s3.us-west-2.amazonaws.com/pytorch-1.10.0/build-artifacts/2022-03-12-00-33/smdistributed_modelparallel-1.8.0-cp38-cp38-linux_x86_64.whl
40
+
41
+
42
+ ----
43
+
44
+ Release History
45
+ ===============
46
+
47
+ SageMaker Distributed Model Parallel 1.7.0 Release Notes
48
+ --------------------------------------------------------
49
+
11
50
*Date: March. 07. 2022 *
12
51
13
52
**Currency Updates **
@@ -49,11 +88,6 @@ This version passed benchmark testing and is migrated to the following AWS Deep
49
88
763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training:1.10.2-gpu-py38-cu113-ubuntu20.04-sagemaker
50
89
51
90
52
- ----
53
-
54
- Release History
55
- ===============
56
-
57
91
SageMaker Distributed Model Parallel 1.6.0 Release Notes
58
92
--------------------------------------------------------
59
93
0 commit comments