Skip to content

Commit e1350c6

Browse files
committed
complete arg docstring
1 parent e33374e commit e1350c6

File tree

1 file changed

+4
-2
lines changed

1 file changed

+4
-2
lines changed

doc/api/training/smp_versions/latest/smd_model_parallel_pytorch_tensor_parallel.rst

+4-2
Original file line numberDiff line numberDiff line change
@@ -301,8 +301,7 @@ Tensor Parallelism Module APIs
301301
``post_layernorm`` must be ``True``.
302302
- ``post_layernorm``: If ``True``, inserts layer normalization at
303303
the output. At least one of ``pre_layernorm`` and
304-
``post_layernorm`` must be ``True``. (Available from
305-
the SageMaker model parallelism library v1.15.0.)
304+
``post_layernorm`` must be ``True``.
306305
- ``use_alibi`` (bool, default False): Activates Attention with
307306
Linear Biases (ALiBi) for attention computation.
308307
ALiBi facilitates efficient extrapolation on input sequences
@@ -314,6 +313,9 @@ Tensor Parallelism Module APIs
314313
details on the technique.
315314
(Available from
316315
the SageMaker model parallelism library v1.15.0.)
316+
- ``alibi_bias_max`` (int, default 8): Defines the ALiBi base
317+
value for mask generation. (Available from
318+
the SageMaker model parallelism library v1.15.0.)
317319

318320
- **Methods:**
319321

0 commit comments

Comments
 (0)