Skip to content

Make code_location to be S3 URI instead of bucket in training_config() #501

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 3 commits into from
Nov 20, 2018

Conversation

yangaws
Copy link
Contributor

@yangaws yangaws commented Nov 19, 2018

Issue #, if available:

Description of changes:
The docstring for code_location is not correct. code_location can be a S3 URI, not just a bucket. And I need to change related Airflow API because it treats code_location as a bucket.

Merge Checklist

Put an x in the boxes that apply. You can also fill these out after creating the PR. If you're unsure about any of them, don't hesitate to ask. We're here to help! This is simply a reminder of what we are going to look for before merging your pull request.

  • I have read the CONTRIBUTING doc
  • I have added tests that prove my fix is effective or that my feature works (if appropriate)
  • I have updated the changelog with a description of my changes (if appropriate)
  • I have updated any necessary documentation (if appropriate)

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

@yangaws yangaws requested a review from jesterhazy November 19, 2018 21:45
@codecov-io
Copy link

Codecov Report

Merging #501 into master will increase coverage by <.01%.
The diff coverage is 100%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master     #501      +/-   ##
==========================================
+ Coverage   94.29%   94.29%   +<.01%     
==========================================
  Files          59       59              
  Lines        4610     4613       +3     
==========================================
+ Hits         4347     4350       +3     
  Misses        263      263
Impacted Files Coverage Δ
src/sagemaker/estimator.py 90.5% <ø> (ø) ⬆️
src/sagemaker/workflow/airflow.py 92.22% <100%> (+0.13%) ⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update b096cd1...13dfe3d. Read the comment docs.

If not specified, default bucket created by ``sagemaker.session.Session`` is used.
The default S3 path is default_bucket/job-name/source/.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

including s3 protocol makes this clearer (s3://default_bucket/...)

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Updated.

@@ -670,8 +670,9 @@ def __init__(self, entry_point, source_dir=None, hyperparameters=None, enable_cl
training jobs. This will be ignored for now and removed in a further release.
container_log_level (int): Log level to use within the container (default: logging.INFO).
Valid values are defined in the Python logging module.
code_location (str): Name of the S3 bucket where custom code is uploaded (default: None).
code_location (str): The S3 URI where custom code is uploaded (default: None).
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

let's fix this to make it clear we expect a prefix and will append /source/sourcedir.tar.gz

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Updated.

@jesterhazy jesterhazy merged commit d83f260 into aws:master Nov 20, 2018
metrizable pushed a commit to metrizable/sagemaker-python-sdk that referenced this pull request Dec 1, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants