Skip to content

documentation: SageMaker distributed - model parallism library release note #3621

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 4 commits into from
Feb 2, 2023
Merged

documentation: SageMaker distributed - model parallism library release note #3621

Show file tree
Hide file tree
Changes from 2 commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
8a971c0
smdmp release note
mchoi8739 Jan 31, 2023
4d3262f
minor update
mchoi8739 Jan 31, 2023
10dc108
incorporate feedback + tiny fix
mchoi8739 Jan 31, 2023
c33329a
tiny fix
mchoi8739 Jan 31, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
44 changes: 39 additions & 5 deletions ...api/training/smd_model_parallel_release_notes/smd_model_parallel_change_log.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,9 +6,47 @@ New features, bug fixes, and improvements are regularly made to the SageMaker
distributed model parallel library.


SageMaker Distributed Model Parallel 1.13.0 Release Notes
SageMaker Distributed Model Parallel 1.14.0 Release Notes
=========================================================

*Date: Jan. 30. 2023*

**Currency Updates**

* Added support for PyTorch v1.13.1

**Improvements**

* Upgraded the flash-attention (https://github.com/HazyResearch/flash-attention) library to v0.2.6.post1

**Migration to AWS Deep Learning Containers**

This version passed benchmark testing and is migrated to the following AWS Deep Learning Containers (DLC):

- SageMaker training container for PyTorch v1.13.1

.. code::

763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training:1.13.1-gpu-py39-cu117-ubuntu20.04-sagemaker


Binary file of this version of the library for `custom container
<https://docs.aws.amazon.com/sagemaker/latest/dg/model-parallel-sm-sdk.html#model-parallel-bring-your-own-container>`_ users:

- For PyTorch 1.12.0
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: This should be - For PyTorch 1.13.1

Copy link
Contributor Author

@mchoi8739 mchoi8739 Jan 31, 2023 •
edited
Loading

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

incorporated! Thank you for catching it.

Copy link

@sheilaliuxl sheilaliuxl Jan 31, 2023 •
edited
Loading

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you!!

Another similar nit change: On line 87 on Dec 15th 2022, it should be - For PyTorch 1.12.1 (instead of 1.12.0)


.. code::

https://sagemaker-distributed-model-parallel.s3.us-west-2.amazonaws.com/pytorch-1.13.1/build-artifacts/2023-01-19-18-35/smdistributed_modelparallel-1.14.0-cp39-cp39-linux_x86_64.whl

----

Release History
===============

SageMaker Distributed Model Parallel 1.13.0 Release Notes
---------------------------------------------------------

Copy link

@sheilaliuxl sheilaliuxl Jan 31, 2023 •
edited
Loading

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This might be irrelevant with the release this time, but we can fix it either in the same PR or a different PR:

  • Line 129 shows an incomplete link https://sagemaker-distribu, for the release on August 17th 2022.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fixed it

*Date: Dec. 15. 2022*

**New Features**
Expand Down Expand Up @@ -52,10 +90,6 @@ Binary file of this version of the library for `custom container

https://sagemaker-distributed-model-parallel.s3.us-west-2.amazonaws.com/pytorch-1.12.1/build-artifacts/2022-12-08-21-34/smdistributed_modelparallel-1.13.0-cp38-cp38-linux_x86_64.whl

----

Release History
===============

SageMaker Distributed Model Parallel 1.11.0 Release Notes
---------------------------------------------------------
Expand Down
2 changes: 1 addition & 1 deletion doc/api/training/smp_versions/latest.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@ depending on which version of the library you need to use.
To use the library, reference the
**Common API** documentation alongside the framework specific API documentation.

Version 1.11.0, 1.13.0 (Latest)
Version 1.11.0, 1.13.0, 1.14.0 (Latest)
===============================

To use the library, reference the Common API documentation alongside the framework specific API documentation.
Expand Down