Skip to content

Fix local mode not using the right s3 bucket. #144

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Apr 13, 2018

Conversation

iquintero
Copy link
Contributor

@iquintero iquintero commented Apr 12, 2018

Description of changes:
Local Mode should honor the inputs instead of wrongly assuming that
everyone is using the default bucket. Fixes #137 #145

Merge Checklist

  • I have read the CONTRIBUTING doc
  • I have added tests that prove my fix is effective or that my feature works (if appropriate)
  • I have updated the changelog with a description of my changes (if appropriate)
  • I have updated any necessary documentation (if appropriate)

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

Local Mode should honor the inputs instead of wrongly assuming that
everyone is using the default bucket.
@iquintero iquintero requested review from winstonaws and owen-t April 12, 2018 22:11
@codecov-io
Copy link

codecov-io commented Apr 12, 2018

Codecov Report

Merging #144 into master will increase coverage by 0.2%.
The diff coverage is 100%.

Impacted file tree graph

@@            Coverage Diff            @@
##           master     #144     +/-   ##
=========================================
+ Coverage   90.27%   90.48%   +0.2%     
=========================================
  Files          36       36             
  Lines        2438     2438             
=========================================
+ Hits         2201     2206      +5     
+ Misses        237      232      -5
Impacted Files Coverage Δ
src/sagemaker/local/image.py 87.4% <100%> (+1.85%) ⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 524dc86...57b8289. Read the comment docs.

Copy link
Contributor

@winstonaws winstonaws left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

As we discussed - can you add unit test(s) so we don't decrease coverage?

s3_uri = channel['DataSource']['S3DataSource']['S3Uri']
if 's3://' in s3_uri:
bucket, prefix = s3_uri.replace('s3://', '').split('/')
download_folder_calls.append(call(bucket, prefix, ANY))
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Instead of ANY for the channel_dir param - is there a clean way to verify the right argument is being passed?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Also, I'd recommend just hard coding the expect result rather than using this for loop.

Also added the changelog entry
@iquintero iquintero merged commit d76cd2b into aws:master Apr 13, 2018
@professoroakz
Copy link

Amazing! Ya'll know when this will be released in stable?

@iquintero iquintero deleted the fix_local_mode_bucket branch May 9, 2018 23:19
apacker pushed a commit to apacker/sagemaker-python-sdk that referenced this pull request Nov 15, 2018
Updated: README to include video games, TensorFlow BYOM, and basic setup
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Training data not loaded from S3 when training locally
4 participants