You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
- Added extended memory-saving features for PyTorch 1.8.1:
11
+
12
+
- Tensor parallelism
13
+
- Optimizer state sharding
14
+
- Activation checkpointing
15
+
- Activation offloading
16
+
17
+
For more information, see the following documentation:
18
+
19
+
- `SageMaker distributed model parallel developer guide <https://docs.aws.amazon.com/sagemaker/latest/dg/model-parallel-extended-features-pytorch.html>`_
20
+
- `SageMaker distributed model parallel API documentation for v1.6.0 <https://sagemaker.readthedocs.io/en/stable/api/training/smp_versions/latest.html>`_
21
+
22
+
**Migration to AWS Deep Learning Containers**
23
+
24
+
This version passed benchmark testing and is migrated to the following
0 commit comments