Skip to content

Commit 2bed7e2

Browse files
authored
Merge branch 'master' into clarify-step
2 parents 7f9fccc + ef7c5a0 commit 2bed7e2

File tree

457 files changed

+39594
-20334
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

457 files changed

+39594
-20334
lines changed

.github/ISSUE_TEMPLATE/bug_report.md

+1
Original file line numberDiff line numberDiff line change
@@ -12,6 +12,7 @@ A clear and concise description of what the bug is.
1212

1313
**To reproduce**
1414
A clear, step-by-step set of instructions to reproduce the bug.
15+
The provided code need to be **complete** and **runnable**, if additional data is needed, please include them in the issue.
1516

1617
**Expected behavior**
1718
A clear and concise description of what you expected to happen.

.gitignore

+1
Original file line numberDiff line numberDiff line change
@@ -34,3 +34,4 @@ env/
3434
**/_repack_script_launcher.sh
3535
tests/data/**/_repack_model.py
3636
tests/data/experiment/sagemaker-dev-1.0.tar.gz
37+
src/sagemaker/serve/tmp_workspace

CHANGELOG.md

+119
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,124 @@
11
# Changelog
22

3+
## v2.202.0 (2023-12-21)
4+
5+
### Features
6+
7+
* support remote debug for sagemaker training job
8+
9+
### Bug Fixes and Other Changes
10+
11+
* update image_uri_configs 12-21-2023 08:32:41 PST
12+
* Update tblib constraint
13+
14+
## v2.201.0 (2023-12-20)
15+
16+
### Features
17+
18+
* Use specific images for SMP v2 jobs
19+
* Added update for model package
20+
21+
### Bug Fixes and Other Changes
22+
23+
* Add write permission to job output dirs for remote and step decorator running on non-root job user
24+
* Move func and args serialization of function step to step level
25+
26+
### Documentation Changes
27+
28+
* SMP v2 doc updates (#1423)
29+
* fix ModelBuilder sample notebook links
30+
31+
## v2.200.1 (2023-12-14)
32+
33+
### Bug Fixes and Other Changes
34+
35+
* Merge branch 'master-rba' into local_merge
36+
* Fix user agent tag issue
37+
* update image_uri_configs 12-13-2023 14:04:54 PST
38+
* update image_uri_configs 12-13-2023 12:23:06 PST
39+
40+
## v2.200.0 (2023-12-13)
41+
42+
### Deprecations and Removals
43+
44+
* remove explicit `partitions` key requirement on pysdk side.
45+
46+
### Features
47+
48+
* add non-repeating config logger
49+
* Add SageMaker Geospatial verison 1.x images
50+
* TGI 1.2.0 Image Uri
51+
* support model.register() with triton model
52+
* Enable retrieving function step results for local mode
53+
54+
### Bug Fixes and Other Changes
55+
56+
* TGI 1.3.1
57+
* excessive jumpstart instance type logging
58+
* Support local mode for remote function
59+
* `Session.download_data` can not download nested objects
60+
* Fix writing into non-closed file with git clone command
61+
* mitigation of xgboost container incompatibility with new version
62+
* update image and hardware validation with inf and graviton
63+
* remove two setuptools deprecations
64+
* minor jumpstart dev ex improvements
65+
* save utils fix
66+
* Correct DJL neuronx regions
67+
* delete unused file inference-experience-dev-tester.sh
68+
* Fix Experiment Run integ test w.r.t unexpected boto3 version
69+
* Bump test dependencies versions
70+
* fast follow on js uncompressed support - ModelBuilder
71+
* Modify Region List for Neuron Images (HF neuron/neuronx, PT Neuron)
72+
73+
### Documentation Changes
74+
75+
* Mention for custom Docker Image
76+
77+
## v2.199.0 (2023-11-30)
78+
79+
### Features
80+
81+
* Update boto3 version to 1.33.3
82+
* Goldfinch InferenceComponent integration
83+
* Add Pipeline step decorator, NotebookJobStep, and scheduler
84+
* ModelBuilder for simplified model testing and deployment
85+
86+
### Bug Fixes and Other Changes
87+
88+
* Skip failing integ tests
89+
* chore: add jumpstart gated model integration tests
90+
* disable integration tests for Inference Component based endpoint for non supported regions
91+
* remove unnecessary whl file - Galactus
92+
* refactor endpoint type enums, comments, docstrings, method names…
93+
* Address SA feedback regarding deployment straight to Endpoint Mode - Galactus
94+
* fix HuggingFace GEN2 model deployment arguments
95+
* when customer role does not have permission to read logs from CW, default to standard logging - Galactus
96+
* Add pagination for ListInferenceComponent API responses, address non-blocking comments
97+
* Create CSVSerializerWrapper - Galactus
98+
* Model builder Final Fixes
99+
* remote function include_local_workdir default value
100+
* use copy instead of move in bootstrap script
101+
* WaiterError on failed pipeline execution. results()
102+
* Add a unit test for consistency between step and remote decorator
103+
* merge WorkdirConfig and custom_filter_filter parameters
104+
* Add back mixed step type integ test
105+
* do not delete temp folder generated by sdist
106+
* make collect_parameters decorator as private
107+
* HMAC signing for ModelBuilder Triton python backend
108+
109+
### Documentation Changes
110+
111+
* update docstring for Generation two endpoint and validation message
112+
* galactus doc updates
113+
* CustomFileFilter doc updates
114+
* NotebookJobSteps class parameter severity update
115+
116+
## v2.198.0 (2023-11-27)
117+
118+
### Features
119+
120+
* re:Invent 2023 keynote1
121+
3122
## v2.197.0 (2023-11-07)
4123

5124
### Features

MANIFEST.in

+1
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,7 @@
11
recursive-include src/sagemaker *.py
22

33
include src/sagemaker/image_uri_config/*.json
4+
include src/sagemaker/serve/requirements.txt
45
recursive-include requirements *
56

67
include VERSION

VERSION

+1-1
Original file line numberDiff line numberDiff line change
@@ -1 +1 @@
1-
2.197.1.dev0
1+
2.202.1.dev0

doc/api/inference/model_builder.rst

+16
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,16 @@
1+
Model Builder
2+
-------------
3+
4+
This module contains classes related to Amazon Sagemaker Model Builder
5+
6+
.. autoclass:: sagemaker.serve.builder.model_builder.ModelBuilder
7+
8+
.. automethod:: sagemaker.serve.builder.model_builder.ModelBuilder.build
9+
10+
.. automethod:: sagemaker.serve.builder.model_builder.ModelBuilder.save
11+
12+
.. autoclass:: sagemaker.serve.spec.inference_spec.InferenceSpec
13+
14+
.. autoclass:: sagemaker.serve.builder.schema_builder.SchemaBuilder
15+
16+
.. autoclass:: sagemaker.serve.marshalling.custom_payload_translator.CustomPayloadTranslator

doc/api/training/distributed.rst

+16-7
Original file line numberDiff line numberDiff line change
@@ -22,10 +22,19 @@ The SageMaker Distributed Data Parallel Library
2222
The SageMaker Distributed Model Parallel Library
2323
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
2424

25-
.. toctree::
26-
:maxdepth: 2
27-
28-
smd_model_parallel
29-
smp_versions/latest
30-
smd_model_parallel_general
31-
smd_model_parallel_release_notes/smd_model_parallel_change_log
25+
.. note::
26+
27+
Since the release of the SageMaker model parallelism (SMP) version 2 in December 2023,
28+
this documentation is no longer supported for maintenence.
29+
The live documentation is available at
30+
`SageMaker model parallelism library v2
31+
<https://docs.aws.amazon.com/sagemaker/latest/dg/model-parallel-v2.html>`_
32+
in the *Amazon SageMaker User Guide*.
33+
34+
The documentation for the SMP library v1.x is archived and available at
35+
`Run distributed training with the SageMaker model parallelism library
36+
<https://docs.aws.amazon.com/sagemaker/latest/dg/model-parallel.html>`_
37+
in the *Amazon SageMaker User Guide*,
38+
and the SMP v1.x API reference is available in the
39+
`SageMaker Python SDK v2.199.0 documentation
40+
<https://sagemaker.readthedocs.io/en/v2.199.0/api/training/distributed.html#the-sagemaker-distributed-model-parallel-library>`_.

doc/api/training/smd_model_parallel.rst

-43
This file was deleted.

0 commit comments

Comments
 (0)