Feat/jumpstart model estimator classes #3796

evakravi · 2023-04-18T21:46:38Z

Issue #, if available:

Description of changes:
Implements JumpStartModel, JumpStartEstimator, and supporting utilities.

JumpStartModel and JumpStartEstimator are child classes of Model and Estimator. By just supplying a model id, these classes will provide defaults for necessary fields for launching a training job or inference hosting endpoint. All the kwarg arguments are over-writable by the user, so they can customize their resources.

Example workflow:

from sagemaker.jumpstart.model import JumpStartModel

model_id = "huggingface-eqa-bert-base-cased"

my_model = JumpStartModel(model_id=model_id)

predictor = my_model.deploy()

question = "What is Southern California often abbreviated as?"

response = predictor.predict(question)

print(response)

>> "SoCal"

important files to review:

src/sagemaker/jumpstart/model.py
src/sagemaker/jumpstart/estimator.py
src/sagemaker/jumpstart/factory/model.py
src/sagemaker/jumpstart/factory/estimator.py

Testing done:

Unit tests and integration tests have been added.

Merge Checklist

Put an x in the boxes that apply. You can also fill these out after creating the PR. If you're unsure about any of them, don't hesitate to ask. We're here to help! This is simply a reminder of what we are going to look for before merging your pull request.

General

I have read the CONTRIBUTING doc
I certify that the changes I am introducing will be backward compatible, and I have discussed concerns about this, if any, with the Python SDK team
I used the commit message format described in CONTRIBUTING
I have passed the region in to all S3 and STS clients that I've initialized as part of this change.
I have updated any necessary documentation, including READMEs and API docs (if appropriate)

Tests

I have added tests that prove my fix is effective or that my feature works (if appropriate)
I have added unit and/or integration tests as appropriate to ensure backward compatibility of the changes
I have checked that my tests are not configured for a specific region or account (if appropriate)
I have used unique_name_from_base to create resource names in integ tests (if appropriate)

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

…vars

…ator-class

Feat/jumpstart kwargs env vars

…ator-classes

sagemaker-bot · 2023-04-18T21:54:59Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: f120e0d
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2023-04-18T22:45:55Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: f120e0d
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2023-04-18T22:47:32Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-notebook-tests
Commit ID: f120e0d
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2023-04-18T23:05:21Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-pr
Commit ID: f120e0d
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2023-04-18T23:19:07Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: f120e0d
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

src/sagemaker/jumpstart/artifacts.py

sagemaker-bot · 2023-04-20T13:36:44Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-pr
Commit ID: f90a68f
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2023-04-20T13:37:25Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: f90a68f
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2023-05-08T20:06:38Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-pr
Commit ID: 8b55e39
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2023-05-08T20:12:39Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: 8b55e39
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

…ator-classes

sagemaker-bot · 2023-05-09T15:18:42Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: 58b440e
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2023-05-09T15:24:37Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-pr
Commit ID: 58b440e
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2023-05-09T15:26:03Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: 58b440e
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2023-05-09T15:31:02Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-notebook-tests
Commit ID: 58b440e
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2023-05-09T15:40:32Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: 58b440e
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

mufaddal-rohawala

/bot run pr

mufaddal-rohawala

/bot run slow-tests

sagemaker-bot · 2023-05-09T17:53:30Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-pr
Commit ID: 58b440e
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2023-05-09T18:45:12Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: f04d38c
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2023-05-09T18:45:44Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-pr
Commit ID: f04d38c
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2023-05-09T18:49:10Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-notebook-tests
Commit ID: f04d38c
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2023-05-09T19:45:09Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: 739b2da
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2023-05-09T19:49:59Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-pr
Commit ID: 739b2da
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2023-05-09T19:53:37Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-notebook-tests
Commit ID: 739b2da
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2023-05-09T20:02:53Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: 739b2da
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2023-05-09T20:48:39Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-pr
Commit ID: e629484
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2023-05-09T21:01:10Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: e629484
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2023-05-09T21:07:36Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-notebook-tests
Commit ID: e629484
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2023-05-09T21:16:37Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: e629484
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2023-05-09T21:34:49Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: e629484
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

evakravi and others added 17 commits April 13, 2023 17:50

feat: jumpstart kwargs and env vars

881fda6

fix: typo

b0efda2

feat: jumpstart model and estimator class (initial commit)

48b62b8

chore: fix metadata field name, update integ test

203ecce

Merge remote-tracking branch 'origin' into feat/jumpstart-kwargs-env-…

d170464

…vars

chore: address PR feedback

49be6f0

fix: pylint

18880b6

chore: respond to git comments (wip)

b1fc3c0

Merge remote-tracking branch 'origin' into feat/jumpstart-model-estim…

949d5cf

…ator-class

Merge pull request #5 from evakravi/feat/jumpstart-kwargs-env-vars

a48929e

Feat/jumpstart kwargs env vars

feat: jumpstart predictor

920715f

chore: use public methods

cc10706

fix: unit tests failing

3197d3b

chore: address PR comments

9fffdb8

fix: jumpstart predictor class support following integ tests

343ddd2

chore: remove functional import

25ad8b5

fix: merge conflicts

5be80e3

evakravi requested a review from a team as a code owner April 18, 2023 21:46

evakravi requested review from vikas0203 and removed request for a team April 18, 2023 21:46

Merge remote-tracking branch 'origin' into feat/jumpstart-model-estim…

f120e0d

…ator-classes

whittech1 reviewed Apr 19, 2023

View reviewed changes

src/sagemaker/jumpstart/artifacts.py Outdated Show resolved Hide resolved

chore: working JumpStartEstimator and JumpStartModel

f90a68f

Merge remote-tracking branch 'origin' into feat/jumpstart-model-estim…

58b440e

…ator-classes

mufaddal-rohawala approved these changes May 9, 2023

View reviewed changes

mufaddal-rohawala reviewed May 9, 2023

View reviewed changes

Merge branch 'master' into feat/jumpstart-model-estimator-classes

f04d38c

Merge branch 'master' into feat/jumpstart-model-estimator-classes

739b2da

fix: predictor with accept/content type

e629484

mufaddal-rohawala approved these changes May 9, 2023

View reviewed changes

mufaddal-rohawala merged commit aefdcb7 into aws:master May 9, 2023

athewsey mentioned this pull request Jul 5, 2023

[Docs] De/Serializers no longer appear in the API doc #3976

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Feat/jumpstart model estimator classes #3796

Feat/jumpstart model estimator classes #3796

evakravi commented Apr 18, 2023 •

edited

Loading

sagemaker-bot commented Apr 18, 2023

sagemaker-bot commented Apr 18, 2023

sagemaker-bot commented Apr 18, 2023

sagemaker-bot commented Apr 18, 2023

sagemaker-bot commented Apr 18, 2023

sagemaker-bot commented Apr 20, 2023

sagemaker-bot commented Apr 20, 2023

sagemaker-bot commented May 8, 2023

sagemaker-bot commented May 8, 2023

sagemaker-bot commented May 9, 2023

sagemaker-bot commented May 9, 2023

sagemaker-bot commented May 9, 2023

sagemaker-bot commented May 9, 2023

sagemaker-bot commented May 9, 2023

mufaddal-rohawala left a comment

mufaddal-rohawala left a comment

sagemaker-bot commented May 9, 2023

sagemaker-bot commented May 9, 2023

sagemaker-bot commented May 9, 2023

sagemaker-bot commented May 9, 2023

sagemaker-bot commented May 9, 2023

sagemaker-bot commented May 9, 2023

sagemaker-bot commented May 9, 2023

sagemaker-bot commented May 9, 2023

sagemaker-bot commented May 9, 2023

sagemaker-bot commented May 9, 2023

sagemaker-bot commented May 9, 2023

sagemaker-bot commented May 9, 2023

sagemaker-bot commented May 9, 2023

Feat/jumpstart model estimator classes #3796

Feat/jumpstart model estimator classes #3796

Conversation

evakravi commented Apr 18, 2023 • edited Loading

Merge Checklist

General

Tests

sagemaker-bot commented Apr 18, 2023

AWS CodeBuild CI Report

sagemaker-bot commented Apr 18, 2023

AWS CodeBuild CI Report

sagemaker-bot commented Apr 18, 2023

AWS CodeBuild CI Report

sagemaker-bot commented Apr 18, 2023

AWS CodeBuild CI Report

sagemaker-bot commented Apr 18, 2023

AWS CodeBuild CI Report

sagemaker-bot commented Apr 20, 2023

AWS CodeBuild CI Report

sagemaker-bot commented Apr 20, 2023

AWS CodeBuild CI Report

sagemaker-bot commented May 8, 2023

AWS CodeBuild CI Report

sagemaker-bot commented May 8, 2023

AWS CodeBuild CI Report

sagemaker-bot commented May 9, 2023

AWS CodeBuild CI Report

sagemaker-bot commented May 9, 2023

AWS CodeBuild CI Report

sagemaker-bot commented May 9, 2023

AWS CodeBuild CI Report

sagemaker-bot commented May 9, 2023

AWS CodeBuild CI Report

sagemaker-bot commented May 9, 2023

AWS CodeBuild CI Report

mufaddal-rohawala left a comment

Choose a reason for hiding this comment

mufaddal-rohawala left a comment

Choose a reason for hiding this comment

sagemaker-bot commented May 9, 2023

AWS CodeBuild CI Report

sagemaker-bot commented May 9, 2023

AWS CodeBuild CI Report

sagemaker-bot commented May 9, 2023

AWS CodeBuild CI Report

sagemaker-bot commented May 9, 2023

AWS CodeBuild CI Report

sagemaker-bot commented May 9, 2023

AWS CodeBuild CI Report

sagemaker-bot commented May 9, 2023

AWS CodeBuild CI Report

sagemaker-bot commented May 9, 2023

AWS CodeBuild CI Report

sagemaker-bot commented May 9, 2023

AWS CodeBuild CI Report

sagemaker-bot commented May 9, 2023

AWS CodeBuild CI Report

sagemaker-bot commented May 9, 2023

AWS CodeBuild CI Report

sagemaker-bot commented May 9, 2023

AWS CodeBuild CI Report

sagemaker-bot commented May 9, 2023

AWS CodeBuild CI Report

sagemaker-bot commented May 9, 2023

AWS CodeBuild CI Report

evakravi commented Apr 18, 2023 •

edited

Loading