Skip to content

Add Endpoint & TlsContext to S3ClientConfiguration used by S3TransferManager #2946

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 2 commits into from

Conversation

ron1
Copy link
Contributor

@ron1 ron1 commented Jan 4, 2022

Motivation and Context

Resolves #2945
Also resolves #2740 and #2896

Description

Add Endpoint and TlsContext to S3ClientConfiguration used by S3TransferManager

Testing

Tested locally.

Screenshots (if appropriate)

Types of changes

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)

Checklist

  • I have read the CONTRIBUTING document
  • Local run of mvn install succeeds
  • My code follows the code style of this project
  • My change requires a change to the Javadoc documentation
  • I have updated the Javadoc documentation accordingly
  • I have read the README document
  • I have added tests to cover my changes
  • All new and existing tests passed
  • A short description of the change has been added to the CHANGELOG
  • My change is to implement 1.11 parity feature and I have updated LaunchChangelog

License

  • I confirm that this pull request can be released under the Apache 2 license

@ron1 ron1 requested a review from a team as a code owner January 4, 2022 04:45
@ron1 ron1 force-pushed the s3-xfer-mgr-crt-opts branch from 45d4631 to 8c4e638 Compare January 4, 2022 21:03
@ron1 ron1 changed the title Add Endpoint to S3ClientConfiguration used by S3TransferManager Add Endpoint & TlsContext to S3ClientConfiguration used by S3TransferManager Jan 5, 2022
@ron1 ron1 force-pushed the s3-xfer-mgr-crt-opts branch from 4b09c92 to aec0bc6 Compare January 5, 2022 04:16
@ron1 ron1 force-pushed the s3-xfer-mgr-crt-opts branch from aec0bc6 to 3961112 Compare January 5, 2022 21:01
@sonarqubecloud
Copy link

sonarqubecloud bot commented Jan 5, 2022

SonarCloud Quality Gate failed.    Quality Gate failed

Bug A 0 Bugs
Vulnerability A 0 Vulnerabilities
Security Hotspot A 0 Security Hotspots
Code Smell A 0 Code Smells

3.8% 3.8% Coverage
0.0% 0.0% Duplication

@medjaoua
Copy link

Hello,

Can we have a date for validation of this pull request.
I have to add the endpoint in these classes and if done, it will be helpful a lot.

Thanks in advance.

Best Regards,

@zoewangg
Copy link
Contributor

zoewangg commented Jan 12, 2022

Apologies for the delayed response and thank you for your interest in contributing to our project. We are actually working on refactoring on the configuration of the transfer manager; we are planning to remove S3Configuration from the transfer manager builder and allow users to pass the S3AsyncClient where they can configure the endpoint and other settings directly. This way, you don't have to configure the same settings twice on the S3 client as well as the transfer manager.

We will close this PR for now. We appreciate your time and effort spent on this! :)

@zoewangg zoewangg closed this Jan 12, 2022
@ron1
Copy link
Contributor Author

ron1 commented Jan 13, 2022

@zoewangg Do you know if the refactored S3TransferManager will require a CRT-based S3AsyncClient?

@zoewangg
Copy link
Contributor

zoewangg commented Jan 13, 2022

@ron1 The current design is that S3TransferManager will create a CRT based S3AsyncClient by default, but users can pass an instance of S3AsyncClient to it, CRT based or Java based. Would this work for your use-case? We'd love to hear more if you have additional feedback.

@ron1
Copy link
Contributor Author

ron1 commented Jan 19, 2022

@zoewangg Yes, enabling S3TransferManager to consume any S3AsyncClient instance, CRT-based or not, will work for us.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Enhance S3TransferManager S3(Native)ClientConfiguration to include additional CRT S3ClientOptions S3TransferManager ability to set endpointOverride
3 participants