S3TransferManager ability to set endpointOverride

[ehmurray8]

Describe the Feature

With the S3AsyncClient I am able to set the endpointOverride like this.

S3AsyncClient.builder().endpointOverride(URI("http://minio-s3:9000"))

I can't find a way to do the same thing with S3TransferManager.

Is your Feature Request related to a problem?

When running my project locally I am using Minio to mock S3 locally, and I need to be able to send requests to it.

Proposed Solution

I would like to be able to do the same thing with S3TransferManager

 S3TransferManager.builder()
        .s3ClientConfiguration { cfg ->
            cfg.endpointOverride(URI("http://minio-s3:9000"))
        }

Your Environment

• AWS Java SDK version used: 2.17.46-PREVIEW
• JDK version used: 16.0.2
• Operating System and version: Mac M1

[debora-ito]

Thank you for reaching out @ehmurray8. Feature request acknowledged.

[aceeric]

This would be valuable for us as well. Presently, we are using the S3AsyncClient to download 10K-sized objects from Minio because the class supports the endpoint override. The best we can get this way is 4MiB/sec for downloads. In comparison, using the s5cmd utility as a performance benchmark, we are able to get 38MiB/sec performing the same downloads. I'm wondering if the difference is partially due to the S3 Transfer Manager's optimization of multipart downloads.

[openwebsolns]

Is there an update on this feature request?

[zoewangg]

Implemented in #3084. Closing the issue

[github-actions]

⚠️COMMENT VISIBILITY WARNING⚠️

Comments on closed issues are hard for our team to see.
If you need more assistance, please open a new issue that references this one.
If you wish to keep having a conversation with other community members under this issue feel free to do so.