Syncing master-jumpstart with dev #2887

evakravi · 2022-01-31T18:47:22Z

Issue #, if available:

Description of changes:
This PR merges in changes from dev branch to aws:master-jumpstart.

Testing done:

Merge Checklist

Put an x in the boxes that apply. You can also fill these out after creating the PR. If you're unsure about any of them, don't hesitate to ask. We're here to help! This is simply a reminder of what we are going to look for before merging your pull request.

General

I have read the CONTRIBUTING doc
I certify that the changes I am introducing will be backword compatible, and I have discussed concerns about this, if any, with the Python SDK team
I used the commit message format described in CONTRIBUTING
I have passed the region in to all S3 and STS clients that I've initialized as part of this change.
I have updated any necessary documentation, including READMEs and API docs (if appropriate)

Tests

I have added tests that prove my fix is effective or that my feature works (if appropriate)
I have added unit and/or integration tests as appropriate to ensure backward compatibility of the changes
I have checked that my tests are not configured for a specific region or account (if appropriate)
I have used unique_name_from_base to create resource names in integ tests (if appropriate)

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

Co-authored-by: Basil Beirouti <[email protected]>

aws#2790)

…ries (aws#2755) Co-authored-by: Payton Staub <[email protected]> Co-authored-by: Ahsan Khan <[email protected]>

Co-authored-by: Shreya Pandit <[email protected]>

Co-authored-by: Basil Beirouti <[email protected]> Co-authored-by: Payton Staub <[email protected]> Co-authored-by: Ahsan Khan <[email protected]> Co-authored-by: Mufaddal Rohawala <[email protected]> Co-authored-by: Basil Beirouti <[email protected]> Co-authored-by: Payton Staub <[email protected]> Co-authored-by: Shreya Pandit <[email protected]>

* update smdmp change log, archive api doc for 1.4.0 and 1.5.0 * add no-index flags * finish api doc archive * fix: Set ProcessingStep upload locations deterministically to avoid c… (aws#2790) * fix: Prevent repack_model script from referencing nonexistent directories (aws#2755) Co-authored-by: Payton Staub <[email protected]> Co-authored-by: Ahsan Khan <[email protected]> * fix: S3Input - add support for instance attributes (aws#2754) * fix: typos and broken link (aws#2765) Co-authored-by: Shreya Pandit <[email protected]> * add all api docs * add appendix, fix links * structural changes, fix links * incorporate feedback * prepare release v2.72.1 * update development version to v2.72.2.dev0 Co-authored-by: Payton Staub <[email protected]> Co-authored-by: Payton Staub <[email protected]> Co-authored-by: Ahsan Khan <[email protected]> Co-authored-by: Mufaddal Rohawala <[email protected]> Co-authored-by: Mohamed Ali Jamaoui <[email protected]> Co-authored-by: Shreya Pandit <[email protected]> Co-authored-by: ci <ci> Co-authored-by: Jeniya Tabassum <[email protected]>

…s#2815)

Co-authored-by: Basil Beirouti <[email protected]> Co-authored-by: Payton Staub <[email protected]> Co-authored-by: Ahsan Khan <[email protected]> Co-authored-by: Mufaddal Rohawala <[email protected]> Co-authored-by: Basil Beirouti <[email protected]> Co-authored-by: Payton Staub <[email protected]> Co-authored-by: Shreya Pandit <[email protected]> Co-authored-by: Mohamed Ali Jamaoui <[email protected]> Co-authored-by: ci <ci> Co-authored-by: Jeniya Tabassum <[email protected]> Co-authored-by: sreedes <[email protected]> Co-authored-by: Navin Soni <[email protected]> Co-authored-by: Miyoung <[email protected]> Co-authored-by: Ameen Khan <[email protected]> Co-authored-by: Zhankui Lu <[email protected]> Co-authored-by: Xiaoguang Chen <[email protected]> Co-authored-by: Jonathan Guinegagne <[email protected]> Co-authored-by: Zhankui Lu <[email protected]> Co-authored-by: Yifei Zhu <[email protected]> Co-authored-by: Qingzi-Lan <[email protected]>

…ion for lambda step (aws#2824)

Co-authored-by: Ahsan Khan <[email protected]>

Co-authored-by: Payton Staub <[email protected]> Co-authored-by: Ahsan Khan <[email protected]> Co-authored-by: Shreya Pandit <[email protected]> Co-authored-by: Basil Beirouti <[email protected]> Co-authored-by: Mufaddal Rohawala <[email protected]> Co-authored-by: Basil Beirouti <[email protected]> Co-authored-by: Payton Staub <[email protected]> Co-authored-by: Mohamed Ali Jamaoui <[email protected]> Co-authored-by: ci <ci> Co-authored-by: Jeniya Tabassum <[email protected]> Co-authored-by: sreedes <[email protected]> Co-authored-by: Navin Soni <[email protected]> Co-authored-by: Miyoung <[email protected]> Co-authored-by: Ameen Khan <[email protected]> Co-authored-by: Zhankui Lu <[email protected]> Co-authored-by: Navin Soni <[email protected]> Co-authored-by: Xiaoguang Chen <[email protected]> Co-authored-by: Jonathan Guinegagne <[email protected]> Co-authored-by: Zhankui Lu <[email protected]> Co-authored-by: Yifei Zhu <[email protected]> Co-authored-by: Qingzi-Lan <[email protected]>

Currently the Clarify BiasConfig only accepts facet name. Actually Clarify analysis configuration supports both name and index. This commit adds the same support to BiasConfig.

sagemaker-bot · 2022-01-31T19:55:18Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: 81b6751
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-01-31T19:57:09Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: 81b6751
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-01-31T21:01:08Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: 81b6751
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-02-01T14:40:13Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: 81b6751
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-02-01T15:00:39Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: 81b6751
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-02-01T16:02:15Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: 81b6751
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-02-01T20:52:51Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: 81b6751
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

Co-authored-by: Mufaddal Rohawala <[email protected]>

sagemaker-bot · 2022-02-03T07:59:43Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: a6f63b3
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-02-03T09:04:47Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: a6f63b3
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-02-03T09:47:23Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: a6f63b3
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

…on-sdk into master-jumpstart

sagemaker-bot · 2022-02-03T13:53:24Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: 028c70c
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

codecov-commenter · 2022-02-03T14:20:38Z

Codecov Report

Merging #2887 (028c70c) into master-jumpstart (423f389) will increase coverage by 0.21%.
The diff coverage is 96.88%.

@@                 Coverage Diff                  @@
##           master-jumpstart    #2887      +/-   ##
====================================================
+ Coverage             89.31%   89.52%   +0.21%     
====================================================
  Files                   188      195       +7     
  Lines                 16200    16628     +428     
====================================================
+ Hits                  14469    14887     +418     
- Misses                 1731     1741      +10

Impacted Files	Coverage Δ
src/sagemaker/tensorflow/model.py	`90.21% <ø> (ø)`
src/sagemaker/workflow/execution_variables.py	`100.00% <ø> (ø)`
src/sagemaker/lineage/action.py	`85.91% <58.33%> (-14.09%)`	⬇️
src/sagemaker/tuner.py	`97.91% <83.33%> (-0.22%)`	⬇️
src/sagemaker/workflow/properties.py	`88.15% <94.73%> (+0.83%)`	⬆️
...emaker/async_inference/async_inference_response.py	`96.42% <96.42%> (ø)`
src/sagemaker/lineage/query.py	`94.96% <97.61%> (+0.52%)`	⬆️
src/sagemaker/predictor_async.py	`98.94% <98.94%> (ø)`
src/sagemaker/analytics.py	`93.28% <100.00%> (ø)`
...agemaker/async_inference/async_inference_config.py	`100.00% <100.00%> (ø)`
... and 18 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 423f389...028c70c. Read the comment docs.

sagemaker-bot · 2022-02-03T14:47:21Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: 028c70c
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-02-03T14:48:53Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: 028c70c
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

mufaddal-rohawala and others added 30 commits December 8, 2021 14:14

feature: allow conditional parellel builds (aws#2727)

81a453b

fix endpoint bug (aws#2772)

565e70e

Co-authored-by: Basil Beirouti <[email protected]>

fix: local mode - support relative file structure (aws#2768)

34dd43a

prepare release v2.72.0

f8f2dbb

update development version to v2.72.1.dev0

217e8c8

fix: Set ProcessingStep upload locations deterministically to avoid c… (

97b71c2

aws#2790)

fix: Prevent repack_model script from referencing nonexistent directo…

dae7dac

…ries (aws#2755) Co-authored-by: Payton Staub <[email protected]> Co-authored-by: Ahsan Khan <[email protected]>

fix: S3Input - add support for instance attributes (aws#2754)

cef81d4

fix: typos and broken link (aws#2765)

a3b588c

Co-authored-by: Shreya Pandit <[email protected]>

prepare release v2.72.1

a24c397

update development version to v2.72.2.dev0

2dc0f34

fix: Add ContentType in test_auto_ml_describe

0d5e925

fix: Re-deploy static integ test endpoint if it is not found

1403e33

fix: fix kmeans test deletion sequence, increment lineage statics (aw…

42dc98e

…s#2815)

fix: Increment static lineage pipeline (aws#2817)

72d1246

fix: Update CHANGELOG.md (aws#2832)

fadd687

prepare release v2.72.2

15132f6

update development version to v2.72.3.dev0

bb7a351

prepare release v2.72.3

11ce418

update development version to v2.72.4.dev0

c2b5f95

fix: fixes unnecessary session call while generating pipeline definit…

944fbc6

…ion for lambda step (aws#2824)

feature: Add models_v2 under lineage context (aws#2800)

ab44079

feature: enable python 3.9 (aws#2802)

f75c7ca

Co-authored-by: Ahsan Khan <[email protected]>

change: Update CHANGELOG.md (aws#2842)

af0abf2

doc: Document the available ExecutionVariables (aws#2807)

b8e0e87

fix: Remove duplicate vertex/edge in query lineage (aws#2784)

0a65986

yzhu0 and others added 9 commits January 25, 2022 17:14

feature: Add support for SageMaker lineage queries context (aws#2830)

109730e

fix: support specifying a facet by its column index

ead2b16

Currently the Clarify BiasConfig only accepts facet name. Actually Clarify analysis configuration supports both name and index. This commit adds the same support to BiasConfig.

doc: more documentation for serverless inference (aws#2859)

a594ece

prepare release v2.74.0

187c3df

update development version to v2.74.1.dev0

d289377

Add deprecation warning in Clarify DataConfig (aws#2847)

ed7dce3

feature: Update instance types for integ test (aws#2881)

7a347c7

feature: Adds support for async inference (aws#2846)

34b07c0

Merge remote-tracking branch 'origin/dev' into master-jumpstart

81b6751

jeniyat and others added 3 commits February 2, 2022 16:24

fix: update to incorporate black v22, pin tox versions (aws#2889)

90b0b0f

Co-authored-by: Mufaddal Rohawala <[email protected]>

bring in latest changes from master

bb2a1f5

make black happy

a6f63b3

evakravi added 2 commits February 3, 2022 13:26

Merge remote-tracking branch 'origin/dev' into master-jumpstart

7174607

Merge branch 'master-jumpstart' of github.com:evakravi/sagemaker-pyth…

028c70c

…on-sdk into master-jumpstart

shreyapandit approved these changes Feb 3, 2022

View reviewed changes

shreyapandit merged commit b8d0bad into aws:master-jumpstart Feb 3, 2022

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Syncing master-jumpstart with dev #2887

Syncing master-jumpstart with dev #2887

evakravi commented Jan 31, 2022 •

edited

Loading

sagemaker-bot commented Jan 31, 2022

sagemaker-bot commented Jan 31, 2022

sagemaker-bot commented Jan 31, 2022

sagemaker-bot commented Feb 1, 2022

sagemaker-bot commented Feb 1, 2022

sagemaker-bot commented Feb 1, 2022

sagemaker-bot commented Feb 1, 2022

sagemaker-bot commented Feb 3, 2022

sagemaker-bot commented Feb 3, 2022

sagemaker-bot commented Feb 3, 2022

sagemaker-bot commented Feb 3, 2022

codecov-commenter commented Feb 3, 2022 •

edited

Loading

sagemaker-bot commented Feb 3, 2022

sagemaker-bot commented Feb 3, 2022

Syncing master-jumpstart with dev #2887

Syncing master-jumpstart with dev #2887

Conversation

evakravi commented Jan 31, 2022 • edited Loading

Merge Checklist

General

Tests

sagemaker-bot commented Jan 31, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Jan 31, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Jan 31, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Feb 1, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Feb 1, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Feb 1, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Feb 1, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Feb 3, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Feb 3, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Feb 3, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Feb 3, 2022

AWS CodeBuild CI Report

codecov-commenter commented Feb 3, 2022 • edited Loading

Codecov Report

sagemaker-bot commented Feb 3, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Feb 3, 2022

AWS CodeBuild CI Report

evakravi commented Jan 31, 2022 •

edited

Loading

codecov-commenter commented Feb 3, 2022 •

edited

Loading