support TF2.10.1 training DLC #3506

tejaschumbalkar · 2022-12-05T22:11:54Z

Issue #, if available:

Description of changes:

support TF2.10.1 training DLC

Testing done:

Merge Checklist

Put an x in the boxes that apply. You can also fill these out after creating the PR. If you're unsure about any of them, don't hesitate to ask. We're here to help! This is simply a reminder of what we are going to look for before merging your pull request.

General

I have read the CONTRIBUTING doc
I certify that the changes I am introducing will be backward compatible, and I have discussed concerns about this, if any, with the Python SDK team
I used the commit message format described in CONTRIBUTING
I have passed the region in to all S3 and STS clients that I've initialized as part of this change.
I have updated any necessary documentation, including READMEs and API docs (if appropriate)

Tests

I have added tests that prove my fix is effective or that my feature works (if appropriate)
I have added unit and/or integration tests as appropriate to ensure backward compatibility of the changes
I have checked that my tests are not configured for a specific region or account (if appropriate)
I have used unique_name_from_base to create resource names in integ tests (if appropriate)

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

Co-authored-by: Mufaddal Rohawala <[email protected]>

Co-authored-by: Basil Beirouti <[email protected]> Co-authored-by: Kalyani Nikure <[email protected]>

…aws#3438) Co-authored-by: Keshav Chandak <[email protected]>

Co-authored-by: Navin Soni <[email protected]>

* Add DXB region * Remove change from neuron * Adding DXB to TF 2.1.0 and 2.1.1

Co-authored-by: Brock Wade <[email protected]> Co-authored-by: Mufaddal Rohawala <[email protected]>

sagemaker-bot · 2022-12-05T22:15:52Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: 2b3d2b0
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-12-05T22:26:23Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: 2b3d2b0
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-12-05T22:28:04Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: 2b3d2b0
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-12-05T23:03:48Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: 2b3d2b0
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-12-05T23:29:09Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-notebook-tests
Commit ID: 2b3d2b0
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-12-06T00:17:00Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-pr
Commit ID: 2b3d2b0
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

…ws#3492)

sagemaker-bot · 2022-12-06T17:26:33Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: 175ecad
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-12-06T18:07:00Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: 175ecad
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-12-06T18:18:59Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: 175ecad
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-12-06T18:19:09Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-pr
Commit ID: 175ecad
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-12-14T22:00:49Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: 906791b
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

codecov-commenter · 2022-12-14T22:01:14Z

Codecov Report

Merging #3506 (920c2a3) into master (554952e) will decrease coverage by 0.79%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master    #3506      +/-   ##
==========================================
- Coverage   89.55%   88.76%   -0.80%     
==========================================
  Files         960      226     -734     
  Lines       88796    21958   -66838     
==========================================
- Hits        79523    19490   -60033     
+ Misses       9273     2468    -6805

Impacted Files	Coverage Δ
src/sagemaker/fw_utils.py	`90.71% <ø> (ø)`
...on3.10/site-packages/sagemaker/local/exceptions.py
...n3.7/site-packages/sagemaker/experiments/_utils.py
...ython3.7/site-packages/sagemaker/multidatamodel.py
...site-packages/sagemaker/amazon/amazon_estimator.py
...e-packages/sagemaker/debugger/framework_profile.py
...kages/sagemaker/lineage/lineage_trial_component.py
...b/python3.7/site-packages/sagemaker/local/image.py
...hon3.8/site-packages/sagemaker/chainer/__init__.py
.../site-packages/sagemaker/amazon/randomcutforest.py
... and 1177 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

sagemaker-bot · 2022-12-14T22:03:07Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: 906791b
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-12-14T22:14:15Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-pr
Commit ID: 906791b
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-12-14T23:01:40Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: a4dd518
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-12-14T23:02:10Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-pr
Commit ID: a4dd518
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-12-14T23:07:25Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: a4dd518
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-12-14T23:28:05Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-notebook-tests
Commit ID: a4dd518
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-12-14T23:31:18Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: a4dd518
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

knikure

/bot run pr, slow-tests

sagemaker-bot · 2022-12-16T17:38:14Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: a4dd518
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-12-16T18:12:41Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-pr
Commit ID: a4dd518
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-12-16T18:14:54Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: a4dd518
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

knikure · 2022-12-19T17:33:12Z

@tejaschumbalkar Can you fix the pr tests failing for your code change?

sagemaker-bot · 2022-12-21T18:23:18Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-pr
Commit ID: a4dd518
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-12-21T18:39:03Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: a4dd518
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2023-01-03T20:39:00Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: 4f507f7
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2023-01-03T21:26:21Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: 920c2a3
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2023-01-03T21:32:04Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: 920c2a3
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2023-01-03T21:38:23Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-pr
Commit ID: 920c2a3
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2023-01-03T21:45:59Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-notebook-tests
Commit ID: 920c2a3
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2023-01-03T23:38:28Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: 920c2a3
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

knikure

@tejaschumbalkar Can you please resolve conflicts?

tejaschumbalkar · 2023-02-17T19:00:29Z

Closing the PR in favor of #3582

NivekNey and others added 14 commits December 2, 2022 12:48

fix: type hint of PySparkProcessor __init__ (aws#3297)

c97c467

fix: fix PySparkProcessor __init__ params type (aws#3354)

de58941

fix: Allow Py 3.7 for MMS Test Docker env (aws#3080)

41dd330

Co-authored-by: Mufaddal Rohawala <[email protected]>

refactoring : using with statement (aws#3286)

1e23a3f

Update local_requirements.txt PyYAML version (aws#3095)

19efadf

Co-authored-by: Basil Beirouti <[email protected]> Co-authored-by: Kalyani Nikure <[email protected]>

feature: Update TF 2.9 and TF 2.10 inference DLCs (aws#3465)

76f7782

feature: Added transform with monitoring pipeline step in transformer (…

fde0738

…aws#3438) Co-authored-by: Keshav Chandak <[email protected]>

fix: Fix bug forcing uploaded tar to be named sourcedir (aws#3412)

7f9f3b0

feature: Add Code Owners file (aws#3503)

5d59767

Co-authored-by: Navin Soni <[email protected]>

prepare release v2.119.0

0f5cf18

update development version to v2.119.1.dev0

f1f0013

feature: Add DXB region to frameworks by DLC (aws#3387)

bb4b689

* Add DXB region * Remove change from neuron * Adding DXB to TF 2.1.0 and 2.1.1

fix: support idempotency for framework and spark processors (aws#3460)

b68bcd9

Co-authored-by: Brock Wade <[email protected]> Co-authored-by: Mufaddal Rohawala <[email protected]>

support TF2.10.1 training DLC

2b3d2b0

tejaschumbalkar requested a review from a team as a code owner December 5, 2022 22:11

tejaschumbalkar requested review from knikure and removed request for a team December 5, 2022 22:11

tejaschumbalkar changed the title ~~support TF2.10.1 training DLC~~ support TF2.10.1 training and PT1.12 trcomp DLC Dec 5, 2022

tejaschumbalkar changed the title ~~support TF2.10.1 training and PT1.12 trcomp DLC~~ support TF2.10.1 training DLC Dec 5, 2022

feature: Update registries with new region account number mappings. (a…

32969da

…ws#3492)

Merge branch 'master' into tf2.10.1-release

a4dd518

knikure reviewed Dec 16, 2022

View reviewed changes

mufaddal-rohawala force-pushed the master branch from bae3b8b to d000bdc Compare December 20, 2022 00:31

Merge 'upstream/master' into tf2.10.1-release

4f507f7

tejaschumbalkar added 2 commits January 3, 2023 12:39

revert unwanted changes

78ee819

add tf2.10.0 config

920c2a3

knikure reviewed Feb 17, 2023

View reviewed changes

tejaschumbalkar closed this Feb 17, 2023

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

support TF2.10.1 training DLC #3506

support TF2.10.1 training DLC #3506

tejaschumbalkar commented Dec 5, 2022

sagemaker-bot commented Dec 5, 2022

sagemaker-bot commented Dec 5, 2022

sagemaker-bot commented Dec 5, 2022

sagemaker-bot commented Dec 5, 2022

sagemaker-bot commented Dec 5, 2022

sagemaker-bot commented Dec 6, 2022

sagemaker-bot commented Dec 6, 2022

sagemaker-bot commented Dec 6, 2022

sagemaker-bot commented Dec 6, 2022

sagemaker-bot commented Dec 6, 2022

sagemaker-bot commented Dec 14, 2022

codecov-commenter commented Dec 14, 2022 •

edited

Loading

sagemaker-bot commented Dec 14, 2022

sagemaker-bot commented Dec 14, 2022

sagemaker-bot commented Dec 14, 2022

sagemaker-bot commented Dec 14, 2022

sagemaker-bot commented Dec 14, 2022

sagemaker-bot commented Dec 14, 2022

sagemaker-bot commented Dec 14, 2022

knikure left a comment •

edited

Loading

sagemaker-bot commented Dec 16, 2022

sagemaker-bot commented Dec 16, 2022

sagemaker-bot commented Dec 16, 2022

knikure commented Dec 19, 2022

sagemaker-bot commented Dec 21, 2022

sagemaker-bot commented Dec 21, 2022

sagemaker-bot commented Jan 3, 2023

sagemaker-bot commented Jan 3, 2023

sagemaker-bot commented Jan 3, 2023

sagemaker-bot commented Jan 3, 2023

sagemaker-bot commented Jan 3, 2023

sagemaker-bot commented Jan 3, 2023

knikure left a comment

tejaschumbalkar commented Feb 17, 2023

support TF2.10.1 training DLC #3506

support TF2.10.1 training DLC #3506

Conversation

tejaschumbalkar commented Dec 5, 2022

Merge Checklist

General

Tests

sagemaker-bot commented Dec 5, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Dec 5, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Dec 5, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Dec 5, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Dec 5, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Dec 6, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Dec 6, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Dec 6, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Dec 6, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Dec 6, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Dec 14, 2022

AWS CodeBuild CI Report

codecov-commenter commented Dec 14, 2022 • edited Loading

Codecov Report

sagemaker-bot commented Dec 14, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Dec 14, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Dec 14, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Dec 14, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Dec 14, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Dec 14, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Dec 14, 2022

AWS CodeBuild CI Report

knikure left a comment • edited Loading

Choose a reason for hiding this comment

sagemaker-bot commented Dec 16, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Dec 16, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Dec 16, 2022

AWS CodeBuild CI Report

knikure commented Dec 19, 2022

sagemaker-bot commented Dec 21, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Dec 21, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Jan 3, 2023

AWS CodeBuild CI Report

sagemaker-bot commented Jan 3, 2023

AWS CodeBuild CI Report

sagemaker-bot commented Jan 3, 2023

AWS CodeBuild CI Report

sagemaker-bot commented Jan 3, 2023

AWS CodeBuild CI Report

sagemaker-bot commented Jan 3, 2023

AWS CodeBuild CI Report

sagemaker-bot commented Jan 3, 2023

AWS CodeBuild CI Report

knikure left a comment

Choose a reason for hiding this comment

tejaschumbalkar commented Feb 17, 2023

codecov-commenter commented Dec 14, 2022 •

edited

Loading

knikure left a comment •

edited

Loading