feature: Added transform with monitoring pipeline step in transformer #3438

keshav-chandak · 2022-10-26T05:58:38Z

Issue #, if available:

Description of changes:

Testing done:

Merge Checklist

Put an x in the boxes that apply. You can also fill these out after creating the PR. If you're unsure about any of them, don't hesitate to ask. We're here to help! This is simply a reminder of what we are going to look for before merging your pull request.

General

I have read the CONTRIBUTING doc
I certify that the changes I am introducing will be backward compatible, and I have discussed concerns about this, if any, with the Python SDK team
I used the commit message format described in CONTRIBUTING
I have passed the region in to all S3 and STS clients that I've initialized as part of this change.
I have updated any necessary documentation, including READMEs and API docs (if appropriate)

Tests

I have added tests that prove my fix is effective or that my feature works (if appropriate)
I have added unit and/or integration tests as appropriate to ensure backward compatibility of the changes
I have checked that my tests are not configured for a specific region or account (if appropriate)
I have used unique_name_from_base to create resource names in integ tests (if appropriate)

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

sagemaker-bot · 2022-10-26T06:02:45Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: 42fa663
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

src/sagemaker/transformer.py

sagemaker-bot · 2022-10-26T06:40:40Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: 585f6ce
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

codecov-commenter · 2022-10-26T06:42:14Z

Codecov Report

Merging #3438 (58993fb) into master (1fa2377) will decrease coverage by 0.28%.
The diff coverage is 87.40%.

@@            Coverage Diff             @@
##           master    #3438      +/-   ##
==========================================
- Coverage   89.17%   88.88%   -0.29%     
==========================================
  Files         204      212       +8     
  Lines       18979    20458    +1479     
==========================================
+ Hits        16924    18184    +1260     
- Misses       2055     2274     +219

Impacted Files	Coverage Δ
src/sagemaker/feature_store/feature_group.py	`76.52% <ø> (ø)`
src/sagemaker/huggingface/model.py	`89.87% <ø> (ø)`
src/sagemaker/pipeline.py	`85.33% <ø> (ø)`
src/sagemaker/sklearn/model.py	`92.98% <ø> (-1.76%)`	⬇️
...sagemaker/workflow/monitor_batch_transform_step.py	`0.00% <0.00%> (ø)`
src/sagemaker/xgboost/model.py	`96.36% <ø> (-1.82%)`	⬇️
...agemaker/model_monitor/clarify_model_monitoring.py	`89.84% <27.58%> (-5.09%)`	⬇️
src/sagemaker/transformer.py	`85.41% <40.62%> (-9.07%)`	⬇️
src/sagemaker/training_compiler/config.py	`80.43% <60.00%> (-2.90%)`	⬇️
src/sagemaker/pytorch/estimator.py	`94.73% <63.63%> (-5.27%)`	⬇️
... and 49 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

sagemaker-bot · 2022-10-26T06:54:49Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: b3ef11d
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-10-26T07:24:23Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: b3ef11d
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-10-26T07:34:21Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: b3ef11d
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-10-26T07:44:58Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-pr
Commit ID: b3ef11d
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-10-26T07:55:37Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-notebook-tests
Commit ID: b3ef11d
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-10-26T10:11:02Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: a2ac915
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-10-26T10:41:55Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: a2ac915
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-10-26T10:51:10Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: a2ac915
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-10-26T11:03:19Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-pr
Commit ID: a2ac915
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-10-26T11:12:26Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-notebook-tests
Commit ID: a2ac915
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-10-27T06:14:02Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: f3e0d6c
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-10-27T06:43:51Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: f3e0d6c
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-10-27T06:53:25Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: f3e0d6c
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-10-27T07:03:47Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-pr
Commit ID: f3e0d6c
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-10-27T07:13:50Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-notebook-tests
Commit ID: f3e0d6c
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-10-28T05:53:52Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: 3ed916f
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-10-28T06:07:37Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: 3ed916f
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-10-28T06:14:08Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-pr
Commit ID: 3ed916f
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-10-28T06:21:17Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-notebook-tests
Commit ID: 3ed916f
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-10-28T06:22:15Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: 3ed916f
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

adeel-zafar

LGTM

mufaddal-rohawala

/bot run slow-tests

sagemaker-bot · 2022-11-16T00:52:28Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: 3ed916f
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-11-24T02:50:19Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: 3ed916f
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-12-01T00:30:03Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: 5cfbefe
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-12-01T00:37:22Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: 5cfbefe
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-12-01T00:56:15Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-notebook-tests
Commit ID: 5cfbefe
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-12-01T01:02:57Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-pr
Commit ID: 5cfbefe
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-12-01T02:31:31Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: 58993fb
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-12-01T02:35:06Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: 58993fb
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-12-01T03:00:51Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-notebook-tests
Commit ID: 58993fb
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-12-01T03:05:21Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-pr
Commit ID: 58993fb
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-12-01T04:47:40Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: 58993fb
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2022-12-02T02:56:32Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: 58993fb
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

…aws#3438) Co-authored-by: Keshav Chandak <[email protected]>

…#3438) Co-authored-by: Keshav Chandak <[email protected]>

…aws#3438) Co-authored-by: Keshav Chandak <[email protected]>

adeel-zafar suggested changes Oct 26, 2022

View reviewed changes

src/sagemaker/transformer.py Outdated Show resolved Hide resolved

adeel-zafar approved these changes Oct 31, 2022

View reviewed changes

jerrypeng7773 approved these changes Nov 2, 2022

View reviewed changes

mufaddal-rohawala reviewed Nov 16, 2022

View reviewed changes

mufaddal-rohawala assigned knikure Nov 16, 2022

knikure approved these changes Nov 16, 2022

View reviewed changes

feature: Added transform with monitoring pipeline step in transformer

58993fb

knikure merged commit fde0738 into aws:master Dec 2, 2022

mizanfiu pushed a commit to mizanfiu/sagemaker-python-sdk that referenced this pull request Dec 13, 2022

feature: Added transform with monitoring pipeline step in transformer (…

e567682

…aws#3438) Co-authored-by: Keshav Chandak <[email protected]>

mufaddal-rohawala pushed a commit to mufaddal-rohawala/sagemaker-python-sdk that referenced this pull request Dec 19, 2022

feature: Added transform with monitoring pipeline step in transformer (…

ab19cfc

…aws#3438) Co-authored-by: Keshav Chandak <[email protected]>

mufaddal-rohawala pushed a commit that referenced this pull request Dec 20, 2022

feature: Added transform with monitoring pipeline step in transformer (…

95e7d7f

…#3438) Co-authored-by: Keshav Chandak <[email protected]>

JoseJuan98 pushed a commit to JoseJuan98/sagemaker-python-sdk that referenced this pull request Mar 4, 2023

feature: Added transform with monitoring pipeline step in transformer (…

d522d6d

…aws#3438) Co-authored-by: Keshav Chandak <[email protected]>

JoseJuan98 pushed a commit to JoseJuan98/sagemaker-python-sdk that referenced this pull request Mar 4, 2023

feature: Added transform with monitoring pipeline step in transformer (…

6dea045

…aws#3438) Co-authored-by: Keshav Chandak <[email protected]>

nmadan pushed a commit to nmadan/sagemaker-python-sdk that referenced this pull request Apr 18, 2023

feature: Added transform with monitoring pipeline step in transformer (…

6d5aad9

…aws#3438) Co-authored-by: Keshav Chandak <[email protected]>

nmadan pushed a commit to nmadan/sagemaker-python-sdk that referenced this pull request Apr 18, 2023

feature: Added transform with monitoring pipeline step in transformer (…

0427aa7

…aws#3438) Co-authored-by: Keshav Chandak <[email protected]>

feature: Added transform with monitoring pipeline step in transformer #3438

feature: Added transform with monitoring pipeline step in transformer #3438

Conversation

keshav-chandak commented Oct 26, 2022 • edited Loading

Merge Checklist

General

Tests

sagemaker-bot commented Oct 26, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Oct 26, 2022

AWS CodeBuild CI Report

codecov-commenter commented Oct 26, 2022 • edited Loading

Codecov Report

sagemaker-bot commented Oct 26, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Oct 26, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Oct 26, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Oct 26, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Oct 26, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Oct 26, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Oct 26, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Oct 26, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Oct 26, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Oct 26, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Oct 27, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Oct 27, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Oct 27, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Oct 27, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Oct 27, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Oct 28, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Oct 28, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Oct 28, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Oct 28, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Oct 28, 2022

AWS CodeBuild CI Report

adeel-zafar left a comment

Choose a reason for hiding this comment

mufaddal-rohawala left a comment • edited by knikure Loading

Choose a reason for hiding this comment

sagemaker-bot commented Nov 16, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Nov 24, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Dec 1, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Dec 1, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Dec 1, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Dec 1, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Dec 1, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Dec 1, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Dec 1, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Dec 1, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Dec 1, 2022

AWS CodeBuild CI Report

sagemaker-bot commented Dec 2, 2022

keshav-chandak commented Oct 26, 2022 •

edited

Loading

codecov-commenter commented Oct 26, 2022 •

edited

Loading

mufaddal-rohawala left a comment •

edited by knikure

Loading