From 8a971c0b297aa629aa407af9fb338cf04bd91501 Mon Sep 17 00:00:00 2001 From: Miyoung Choi Date: Mon, 30 Jan 2023 21:38:24 -0800 Subject: [PATCH 1/4] smdmp release note --- .../smd_model_parallel_change_log.rst | 44 ++++++++++++++++--- 1 file changed, 39 insertions(+), 5 deletions(-) diff --git a/doc/api/training/smd_model_parallel_release_notes/smd_model_parallel_change_log.rst b/doc/api/training/smd_model_parallel_release_notes/smd_model_parallel_change_log.rst index 92ccc8c407..17dfca5b85 100644 --- a/doc/api/training/smd_model_parallel_release_notes/smd_model_parallel_change_log.rst +++ b/doc/api/training/smd_model_parallel_release_notes/smd_model_parallel_change_log.rst @@ -6,9 +6,47 @@ New features, bug fixes, and improvements are regularly made to the SageMaker distributed model parallel library. -SageMaker Distributed Model Parallel 1.13.0 Release Notes +SageMaker Distributed Model Parallel 1.14.0 Release Notes ========================================================= +*Date: Jan. 30. 2023* + +**Currency Updates** + +* Added support for PyTorch v1.13.1 + +**Improvements** + +* Upgraded the flash-attention (https://github.com/HazyResearch/flash-attention) library to v0.2.6.post1 + +**Migration to AWS Deep Learning Containers** + +This version passed benchmark testing and is migrated to the following AWS Deep Learning Containers (DLC): + +- SageMaker training container for PyTorch v1.13.1 + + .. code:: + + 763104351884.dkr.ecr..amazonaws.com/pytorch-training:1.13.1-gpu-py39-cu117-ubuntu20.04-sagemaker + + +Binary file of this version of the library for `custom container +`_ users: + +- For PyTorch 1.12.0 + + .. code:: + + https://sagemaker-distributed-model-parallel.s3.us-west-2.amazonaws.com/pytorch-1.13.1/build-artifacts/2023-01-19-18-35/smdistributed_modelparallel-1.14.0-cp39-cp39-linux_x86_64.whl + +---- + +Release History +=============== + +SageMaker Distributed Model Parallel 1.13.0 Release Notes +--------------------------------------------------------- + *Date: Dec. 15. 2022* **New Features** @@ -52,10 +90,6 @@ Binary file of this version of the library for `custom container https://sagemaker-distributed-model-parallel.s3.us-west-2.amazonaws.com/pytorch-1.12.1/build-artifacts/2022-12-08-21-34/smdistributed_modelparallel-1.13.0-cp38-cp38-linux_x86_64.whl ----- - -Release History -=============== SageMaker Distributed Model Parallel 1.11.0 Release Notes --------------------------------------------------------- From 4d3262f19629ca276ecec5d589f5e93ac8639506 Mon Sep 17 00:00:00 2001 From: Miyoung Choi Date: Mon, 30 Jan 2023 21:59:35 -0800 Subject: [PATCH 2/4] minor update --- doc/api/training/smp_versions/latest.rst | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/doc/api/training/smp_versions/latest.rst b/doc/api/training/smp_versions/latest.rst index 1eb358b2a3..a689875777 100644 --- a/doc/api/training/smp_versions/latest.rst +++ b/doc/api/training/smp_versions/latest.rst @@ -10,7 +10,7 @@ depending on which version of the library you need to use. To use the library, reference the **Common API** documentation alongside the framework specific API documentation. -Version 1.11.0, 1.13.0 (Latest) +Version 1.11.0, 1.13.0, 1.14.0 (Latest) =============================== To use the library, reference the Common API documentation alongside the framework specific API documentation. From 10dc1084006fe82031b1dc1fd688254d6bce7ab5 Mon Sep 17 00:00:00 2001 From: Miyoung Choi Date: Mon, 30 Jan 2023 23:18:23 -0800 Subject: [PATCH 3/4] incorporate feedback + tiny fix --- .../smd_model_parallel_change_log.rst | 4 ++-- doc/api/training/smp_versions/latest.rst | 2 +- 2 files changed, 3 insertions(+), 3 deletions(-) diff --git a/doc/api/training/smd_model_parallel_release_notes/smd_model_parallel_change_log.rst b/doc/api/training/smd_model_parallel_release_notes/smd_model_parallel_change_log.rst index 17dfca5b85..8a1465ae4e 100644 --- a/doc/api/training/smd_model_parallel_release_notes/smd_model_parallel_change_log.rst +++ b/doc/api/training/smd_model_parallel_release_notes/smd_model_parallel_change_log.rst @@ -33,7 +33,7 @@ This version passed benchmark testing and is migrated to the following AWS Deep Binary file of this version of the library for `custom container `_ users: -- For PyTorch 1.12.0 +- For PyTorch 1.13.1 .. code:: @@ -126,7 +126,7 @@ Binary file of this version of the library for `custom container .. code:: - https://sagemaker-distribu + https://sagemaker-distributed-model-parallel.s3.us-west-2.amazonaws.com/pytorch-1.12.0/build-artifacts/2022-08-12-16-58/smdistributed_modelparallel-1.11.0-cp38-cp38-linux_x86_64.whl SageMaker Distributed Model Parallel 1.10.1 Release Notes --------------------------------------------------------- diff --git a/doc/api/training/smp_versions/latest.rst b/doc/api/training/smp_versions/latest.rst index a689875777..1d18c7cd2a 100644 --- a/doc/api/training/smp_versions/latest.rst +++ b/doc/api/training/smp_versions/latest.rst @@ -11,7 +11,7 @@ To use the library, reference the **Common API** documentation alongside the framework specific API documentation. Version 1.11.0, 1.13.0, 1.14.0 (Latest) -=============================== +======================================= To use the library, reference the Common API documentation alongside the framework specific API documentation. From c33329aa75e3c6055c0a92235b89f46f67ad0e19 Mon Sep 17 00:00:00 2001 From: Miyoung Choi Date: Mon, 30 Jan 2023 23:34:22 -0800 Subject: [PATCH 4/4] tiny fix --- .../smd_model_parallel_change_log.rst | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/doc/api/training/smd_model_parallel_release_notes/smd_model_parallel_change_log.rst b/doc/api/training/smd_model_parallel_release_notes/smd_model_parallel_change_log.rst index 8a1465ae4e..8af4696fc0 100644 --- a/doc/api/training/smd_model_parallel_release_notes/smd_model_parallel_change_log.rst +++ b/doc/api/training/smd_model_parallel_release_notes/smd_model_parallel_change_log.rst @@ -84,7 +84,7 @@ This version passed benchmark testing and is migrated to the following AWS Deep Binary file of this version of the library for `custom container `_ users: -- For PyTorch 1.12.0 +- For PyTorch 1.12.1 .. code::