Code

Reinvent 2024 early#4946

Code

Merged

pintaoz-aws merged 79 commits intomasteraws/sagemaker-python-sdk:masterfrom

reinvent-2024-earlyaws/sagemaker-python-sdk:reinvent-2024-earlyCopy head branch name to clipboard

Dec 4, 2024

Commits

Commits on Dec 4, 2024

• Base model trainer (#1521)

  Show description for e267244
  

  benieric

  authored and

  pintaoz-aws

  committed
  e267244

  Copy full SHA for e267244

• feature: support script mode with local train.sh (#1523)

  Show description for 9774f9e
  

  benieric

  authored and

  pintaoz-aws

  committed
  9774f9e

  Copy full SHA for 9774f9e

• Image Spec refactoring and updates (#1525)

  Show description for fba3285
  

  nargokul

  authored and

  pintaoz-aws

  committed
  fba3285

  Copy full SHA for fba3285

• Add unit tests for ModelTrainer (#1527)

  Show description for 6a0224f
  

  benieric

  authored and

  pintaoz-aws

  committed
  6a0224f

  Copy full SHA for 6a0224f

• Add example notebook (#1528)

  Show description for 7446b09
  

  benieric

  authored and

  pintaoz-aws

  committed
  7446b09

  Copy full SHA for 7446b09

• Add enviornment variable bootstrapping script (#1530)

  Show description for cb7af78
  

  benieric

  authored and

  pintaoz-aws

  committed
  cb7af78

  Copy full SHA for cb7af78

• feature: add utility function to capture local snapshot (#1524)

  Show description for 80a1b89
  pintaoz-aws

  committed
  80a1b89

  Copy full SHA for 80a1b89

• Support intelligent parameters (#1540)

  Show description for 93a3c6d
  pintaoz-aws

  committed
  93a3c6d

  Copy full SHA for 93a3c6d

• Revert Image Spec (#1541)

  

  nargokul

  authored and

  pintaoz-aws

  committed
  4fe8738

  Copy full SHA for 4fe8738

• Cleanup ModelTrainer (#1542)

  

  benieric

  authored and

  pintaoz-aws

  committed
  72e4266

  Copy full SHA for 72e4266

• General image builder (#1546)

  Show description for 89edb6d
  pintaoz-aws

  committed
  89edb6d

  Copy full SHA for 89edb6d

• Latest Container Image (#1545)

  Show description for b40a499
  

  nargokul

  authored and

  pintaoz-aws

  committed
  b40a499

  Copy full SHA for b40a499

• Cleanup ModelTrainer code (#1552)

  

  benieric

  authored and

  pintaoz-aws

  committed
  c3f432c

  Copy full SHA for c3f432c

• feat: add pre-processing and post-processing logic to inference_spec (#1560)

  Show description for 2e17bcb
  

  pravali96

  authored and

  pintaoz-aws

  committed
  2e17bcb

  Copy full SHA for 2e17bcb

• Add Distributed Training Support Model Trainer (#1536)

  

  benieric

  authored and

  pintaoz-aws

  committed
  21a11a9

  Copy full SHA for 21a11a9

• Add path to set Additional Settings in ModelTrainer (#1555)

  

  benieric

  authored and

  pintaoz-aws

  committed
  a406f64

  Copy full SHA for a406f64

• Mask Sensitive Env Logs in Container (#1568)

  

  benieric

  authored and

  pintaoz-aws

  committed
  8cc19a3

  Copy full SHA for 8cc19a3

• Fix bug in script mode setup ModelTrainer (#1575)

  

  benieric

  authored and

  pintaoz-aws

  committed
  a8ed4ec

  Copy full SHA for a8ed4ec

• Feature: ModelBuilder supports HuggingFace Models with benchmark data and deployment configs (#1572)

  

  xiongz945

  authored and

  pintaoz-aws

  committed
  ce55d45

  Copy full SHA for ce55d45

• Simplify Config Class Names and DistributedRunner structures (#1573)

  

  benieric

  authored and

  pintaoz-aws

  committed
  1ad75c9

  Copy full SHA for 1ad75c9

• Remove ignored files

  

  benieric

  authored and

  pintaoz-aws

  committed
  2aad9cd

  Copy full SHA for 2aad9cd

• Add in_process mode support for DJL and TorchServe servers (#1570)

  Show description for fa6ae28
  

  pravali96

  authored and

  pintaoz-aws

  committed
  fa6ae28

  Copy full SHA for fa6ae28

• Pass hyperparameters as CLI args (#1577)

  

  benieric

  authored and

  pintaoz-aws

  committed
  24b0dc0

  Copy full SHA for 24b0dc0

• Trainer handshake (#1535)

  Show description for 053808f
  

  4 peoplecommitted
  053808f

  Copy full SHA for 053808f

• Add Support for Training Recipes (#1565)

  Show description for debcdc2
  

  2 peopleauthored and

  pintaoz-aws

  committed
  debcdc2

  Copy full SHA for debcdc2

• Support building image from Dockerfile (#1571)

  Show description for 8cf9631
  

  4 peoplecommitted
  8cf9631

  Copy full SHA for 8cf9631

• Use exact python path in trainer template (#1584)

  

  benieric

  authored and

  pintaoz-aws

  committed
  51fb427

  Copy full SHA for 51fb427

• Unified Deployment interface in Model Builder (#1549)

  Show description for 70ae24f
  

  4 peoplecommitted
  70ae24f

  Copy full SHA for 70ae24f

• Add recipes examples (#1582)

  

  benieric

  authored and

  pintaoz-aws

  committed
  6b90f89

  Copy full SHA for 6b90f89

• update notebooks (#1588)

  

  benieric

  authored and

  pintaoz-aws

  committed
  67f535d

  Copy full SHA for 67f535d

• update notebooks (#1592)

  

  benieric

  authored and

  pintaoz-aws

  committed
  e4701e8

  Copy full SHA for e4701e8

• Single container local training (#1556)

  Show description for 5a37fc5
  

  4 peoplecommitted
  5a37fc5

  Copy full SHA for 5a37fc5

• Bug fixes (#1596)

  pintaoz-aws

  committed
  5dae384

  Copy full SHA for 5dae384

• Update ModelTrainer Notebooks (#1597)

  

  benieric

  authored and

  pintaoz-aws

  committed
  b29da8f

  Copy full SHA for b29da8f

• add inference morpheus nbs (#1594)

  Show description for 2718402
  

  gwang111

  authored and

  pintaoz-aws

  committed
  2718402

  Copy full SHA for 2718402

• Fix: move the functionality from latest_container_image to retrieve (#1583)

  Show description for 758a311
  

  3 peopleauthored and

  pintaoz-aws

  committed
  758a311

  Copy full SHA for 758a311

• Add bugbash bootstrapping (#1598)

  

  benieric

  authored and

  pintaoz-aws

  committed
  7ef6b99

  Copy full SHA for 7ef6b99

• Fix: remove the special condition and fix the unit test (#1601)

  Show description for 2cc4495
  

  3 peopleauthored and

  pintaoz-aws

  committed
  2cc4495

  Copy full SHA for 2cc4495

• Notebooks update for Bugbash (#1595)

  Show description for df990c0
  

  nargokul

  authored and

  pintaoz-aws

  committed
  df990c0

  Copy full SHA for df990c0

• Add Rich Logging to Model Builder (#1604)

  

  nargokul

  authored and

  pintaoz-aws

  committed
  1a3330a

  Copy full SHA for 1a3330a

• Fix: codestyles (#1606)

  

  benieric

  authored and

  pintaoz-aws

  committed
  611ea9a

  Copy full SHA for 611ea9a

• add modelID support to model builder InProcess model (#1580)

  Show description for fa02963
  

  pravali96

  authored and

  pintaoz-aws

  committed
  fa02963

  Copy full SHA for fa02963

• Update kandinsky in ModelTrainer and allow setting requirements (#1587)

  

  benieric

  authored and

  pintaoz-aws

  committed
  a9dd628

  Copy full SHA for a9dd628

• [Updated] Add telemetry to ModelTrainer, Estimator and ModelBuilder (#1608)

  Show description for 5036fb8
  

  zhaoqizqwang

  authored and

  pintaoz-aws

  committed
  5036fb8

  Copy full SHA for 5036fb8

• Integration tests for Model Builder Handshake (#1610)

  Show description for 1e17a1e
  

  nargokul

  authored and

  pintaoz-aws

  committed
  1e17a1e

  Copy full SHA for 1e17a1e

• Use sagemaker core Session (#1607)

  Show description for aa2e62d
  

  2 peopleauthored and

  pintaoz-aws

  committed
  aa2e62d

  Copy full SHA for aa2e62d

• Skip JS model mapping with env vars or image URI provided (#1599)

  Show description for 2438a3f
  

  7 peoplecommitted
  2438a3f

  Copy full SHA for 2438a3f

• pin xgboost dlc to 1.7.1 to fix test (#1616)

  

  gwang111

  authored and

  pintaoz-aws

  committed
  0e74aff

  Copy full SHA for 0e74aff

• Revert image builder (#1614)

  Show description for 6985ec5
  

  pintaoz-aws

  and

  benieric

  committed
  6985ec5

  Copy full SHA for 6985ec5

• add integ test for base_model_builder_deploy and remove print statement (#1612)

  Show description for bd8e42a
  

  3 peopleauthored and

  pintaoz-aws

  committed
  bd8e42a

  Copy full SHA for bd8e42a

• Fix tests and codestyle (#1619)

  Show description for d544e39
  

  2 peopleauthored and

  pintaoz-aws

  committed
  d544e39

  Copy full SHA for d544e39

• Fix: Correctly serialize SM_HPS env var (#1611)

  

  benieric

  authored and

  pintaoz-aws

  committed
  0a488fe

  Copy full SHA for 0a488fe

• Intelligent defaults for Model Trainer (#1586)

  Show description for 784a18f
  

  nargokul

  authored and

  pintaoz-aws

  committed
  784a18f

  Copy full SHA for 784a18f

• add in-process mode definition to docs (#1622)

  Show description for 9d1a418
  

  2 peopleauthored and

  pintaoz-aws

  committed
  9d1a418

  Copy full SHA for 9d1a418

• Update ModelTrainer Interface Parameters (#1617)

  

  benieric

  authored and

  pintaoz-aws

  committed
  a3e328e

  Copy full SHA for a3e328e

• Model Trainer Bucket improvements (#1618)

  Show description for b50330f
  

  nargokul

  authored and

  pintaoz-aws

  committed
  b50330f

  Copy full SHA for b50330f

• Add interface units for ModelTrainer (#1631)

  

  benieric

  authored and

  pintaoz-aws

  committed
  37f079c

  Copy full SHA for 37f079c

• Update hyperpod recipe uris (#1629)

  

  benieric

  authored and

  pintaoz-aws

  committed
  cbba5eb

  Copy full SHA for cbba5eb

• Integ tests for local mode model trainer (#1623)

  pintaoz-aws

  committed
  4f31237

  Copy full SHA for 4f31237

• Morpheus tests (#1633)

  Show description for 720faab
  

  nargokul

  authored and

  pintaoz-aws

  committed
  720faab

  Copy full SHA for 720faab

• remove example notebooks artifacts (#1634)

  

  benieric

  authored and

  pintaoz-aws

  committed
  98d1d23

  Copy full SHA for 98d1d23

• feat: Partner App Auth Provider for SDK support (#1548)

  Show description for 96db5c7
  

  2 peopleauthored and

  pintaoz-aws

  committed
  96db5c7

  Copy full SHA for 96db5c7

• change: fix the file uploading signature verification error (#1551)

  Show description for cff8216
  

  2 peopleauthored and

  pintaoz-aws

  committed
  cff8216

  Copy full SHA for cff8216

• Feature: Support GPU training recipes with Sagemaker Python SDK (#1516)

  Show description for 45b89cc
  

  schinmayee

  authored and

  pintaoz-aws

  committed
  45b89cc

  Copy full SHA for 45b89cc

• Feature: Support Neuron training recipes. (#1526)

  

  schinmayee

  authored and

  pintaoz-aws

  committed
  13e10c9

  Copy full SHA for 13e10c9

• Feature: Resolve recipes correctly before launching (#1529)

  Show description for 1f34950
  

  schinmayee

  authored and

  pintaoz-aws

  committed
  1f34950

  Copy full SHA for 1f34950

• Feature: Add unit tests for recipes and minor bug fixes. (#1532)

  Show description for e68f4f5
  

  schinmayee

  authored and

  pintaoz-aws

  committed
  e68f4f5

  Copy full SHA for e68f4f5

• Feature: Move image uris and git repos for training recipes to json (#1547)

  

  schinmayee

  authored and

  pintaoz-aws

  committed
  2cc2caf

  Copy full SHA for 2cc2caf

• Update MANIFEST.in so that wheel builds correctly (#1563)

  

  schinmayee

  authored and

  pintaoz-aws

  committed
  9480ee0

  Copy full SHA for 9480ee0

• Remove default values for fields in recipe_overrides and fix recipe path. (#1566)

  

  schinmayee

  authored and

  pintaoz-aws

  committed
  30dfdca

  Copy full SHA for 30dfdca

• Change default source directory to current, add option to specify source dir (#1593)

  

  schinmayee

  authored and

  pintaoz-aws

  committed
  c0e3958

  Copy full SHA for c0e3958

• Changes for SMP v2.7.0 (#1609)

  Show description for ce2376f
  

  2 peopleauthored and

  pintaoz-aws

  committed
  ce2376f

  Copy full SHA for ce2376f

• Update URIs to public for training recipes (#1621)

  Show description for 74d6b7c
  

  schinmayee

  authored and

  pintaoz-aws

  committed
  74d6b7c

  Copy full SHA for 74d6b7c

• Neuron URIs update (#1626)

  Show description for fdf2e9a
  

  schinmayee

  authored and

  pintaoz-aws

  committed
  fdf2e9a

  Copy full SHA for fdf2e9a

• Usage docs for training recipes (#1630)

  Show description for 3bce287
  

  schinmayee

  authored and

  pintaoz-aws

  committed
  3bce287

  Copy full SHA for 3bce287

• Add model trainer documentation (#1639)

  

  benieric

  authored and

  pintaoz-aws

  committed
  bd4a6cc

  Copy full SHA for bd4a6cc

• Enable the Recipe tests marked with @pytest.mark.skip(reason="Hyperpod recipe code unavailable" (#1642)

  

  nargokul

  authored and

  pintaoz-aws

  committed
  9a5b32f

  Copy full SHA for 9a5b32f

• Add graphne to the doc requirements

  pintaoz-aws

  committed
  659244b

  Copy full SHA for 659244b

• Add graphene to doc requirements

  pintaoz-aws

  committed
  ad3538b

  Copy full SHA for ad3538b