Skip to content

documentation: SageMaker distributed - model parallism library release note #3621

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 4 commits into from
Feb 2, 2023
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
Expand Up @@ -6,9 +6,47 @@ New features, bug fixes, and improvements are regularly made to the SageMaker
distributed model parallel library.


SageMaker Distributed Model Parallel 1.13.0 Release Notes
SageMaker Distributed Model Parallel 1.14.0 Release Notes
=========================================================

*Date: Jan. 30. 2023*

**Currency Updates**

* Added support for PyTorch v1.13.1

**Improvements**

* Upgraded the flash-attention (https://github.com/HazyResearch/flash-attention) library to v0.2.6.post1

**Migration to AWS Deep Learning Containers**

This version passed benchmark testing and is migrated to the following AWS Deep Learning Containers (DLC):

- SageMaker training container for PyTorch v1.13.1

.. code::

763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training:1.13.1-gpu-py39-cu117-ubuntu20.04-sagemaker


Binary file of this version of the library for `custom container
<https://docs.aws.amazon.com/sagemaker/latest/dg/model-parallel-sm-sdk.html#model-parallel-bring-your-own-container>`_ users:

- For PyTorch 1.13.1

.. code::

https://sagemaker-distributed-model-parallel.s3.us-west-2.amazonaws.com/pytorch-1.13.1/build-artifacts/2023-01-19-18-35/smdistributed_modelparallel-1.14.0-cp39-cp39-linux_x86_64.whl

----

Release History
===============

SageMaker Distributed Model Parallel 1.13.0 Release Notes
---------------------------------------------------------

Copy link

@sheilaliuxl sheilaliuxl Jan 31, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This might be irrelevant with the release this time, but we can fix it either in the same PR or a different PR:

  • Line 129 shows an incomplete link https://sagemaker-distribu, for the release on August 17th 2022.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fixed it

*Date: Dec. 15. 2022*

**New Features**
Expand Down Expand Up @@ -46,16 +84,12 @@ This version passed benchmark testing and is migrated to the following AWS Deep
Binary file of this version of the library for `custom container
<https://docs.aws.amazon.com/sagemaker/latest/dg/model-parallel-sm-sdk.html#model-parallel-bring-your-own-container>`_ users:

- For PyTorch 1.12.0
- For PyTorch 1.12.1

.. code::

https://sagemaker-distributed-model-parallel.s3.us-west-2.amazonaws.com/pytorch-1.12.1/build-artifacts/2022-12-08-21-34/smdistributed_modelparallel-1.13.0-cp38-cp38-linux_x86_64.whl

----

Release History
===============

SageMaker Distributed Model Parallel 1.11.0 Release Notes
---------------------------------------------------------
Expand Down Expand Up @@ -92,7 +126,7 @@ Binary file of this version of the library for `custom container

.. code::

https://sagemaker-distribu
https://sagemaker-distributed-model-parallel.s3.us-west-2.amazonaws.com/pytorch-1.12.0/build-artifacts/2022-08-12-16-58/smdistributed_modelparallel-1.11.0-cp38-cp38-linux_x86_64.whl

SageMaker Distributed Model Parallel 1.10.1 Release Notes
---------------------------------------------------------
Expand Down
4 changes: 2 additions & 2 deletions doc/api/training/smp_versions/latest.rst
Original file line number Diff line number Diff line change
Expand Up @@ -10,8 +10,8 @@ depending on which version of the library you need to use.
To use the library, reference the
**Common API** documentation alongside the framework specific API documentation.

Version 1.11.0, 1.13.0 (Latest)
===============================
Version 1.11.0, 1.13.0, 1.14.0 (Latest)
=======================================

To use the library, reference the Common API documentation alongside the framework specific API documentation.

Expand Down