Skip to content

Latest commit

 

History

History
184 lines (150 loc) · 6.42 KB

v2-16-02-2024.md

File metadata and controls

184 lines (150 loc) · 6.42 KB

Cold Start Performance - CRT vs UrlConnection HTTP Clients

  • SDK Version: 2.24.4
  • Region: eu-central-1
  • Memory: 512 MB
  • Runtime: Java 11

Results

Ignore the core-utilities data and focus on parameters. It is more indicative and actually uses the SDK clients. the CRT client is slightly slower to start by default.

  • Why? Because the size of the lambda is 2.3x as large with the CRT client
  • Why? Because the library aws-crt used by the CRT client in the SDK to provide the native JNI binaries is itself 18 MB
  • Why? Because the aws-crt library contains binaries for every permutation of OS (Windows, Linux, MacOS), architecture (X86 / AMD64 / ARM6 / ARM7 / ARM8) and runtime (glibc / musl)
  • Why? So that the library is portable

It looks like there are JARs for the different combinations of these parameters. How can we take advantage of this to avoid pulling in the whole world?

Variant 1 - UrlConnectionHttpClient / core-utilities

core-utilities uses the x-ray library, which includes aws-sdk v1 somehow. We should try address this.

SAM Package size: 13.9492 MB

Details 
### Round 1

**Cold Total Requests:**   100
**Cold Total Failures:**   0
**Cold Average Latency:**  5.47396 seconds
**Cold Min Latency:**      4.633158000 seconds
**Cold Max Latency:**      6.193764000 seconds
**Hot Total Requests:**    900
**Hot Total Failures:**    0
**Hot Average Latency:**   0.552285 seconds
**Hot Min Latency:**       .207364000 seconds
**Hot Max Latency:**       2.260201000 seconds

### Round 2
Cold Total Requests:      100
Cold Total Failures:      0
Cold Average Latency:     5.53388 seconds
Cold Min Latency:         4.561750000 seconds
Cold Max Latency:         7.002277000 seconds
Hot Total Requests:       900
Hot Total Failures:       0
Hot Average Latency:      0.568225 seconds
Hot Min Latency:          .233235000 seconds
Hot Max Latency:          2.536131000 seconds

Variant 2 - CrtHttpClient / core-utilities

SAM Package Size: 13.915 MB

Details 
### Round 1

Cold Total Requests:      100
Cold Total Failures:      0
Cold Average Latency:     5.43585 seconds
Cold Min Latency:         4.432624000 seconds
Cold Max Latency:         6.137327000 seconds
Hot Total Requests:       900 /var/folders/r3/hbcg0qqd0qj3rnbc1vfxxycr0000gr/T/tmp.jXWQbrjNr9
Hot Total Failures:       0
Hot Average Latency:      0.269618 seconds
Hot Min Latency:          0.092774000 seconds
Hot Max Latency:          1.424027000 seconds

### Round 2
Cold Total Requests:      100
Cold Total Failures:      0
Cold Average Latency:     5.43387 seconds
Cold Min Latency:         4.364449000 seconds
Cold Max Latency:         6.453559000 seconds
Hot Total Requests:       900 /var/folders/r3/hbcg0qqd0qj3rnbc1vfxxycr0000gr/T/tmp.FJF9f2e77w
Hot Total Failures:       0
Hot Average Latency:      0.419191 seconds
Hot Min Latency:          0.102245000 seconds
Hot Max Latency:          1.643349000 seconds

Variant 3 - UrlHttpClient / parameters

SAM Package size: 15.707 MB

Details 
### Round 1
Cold Total Requests:       70
Cold Total Failures:       0
Cold Average Latency:      6.46384 seconds
Cold Min Latency:          5.227111000 seconds
Cold Max Latency:          7.241240000 seconds
Hot Total Requests:        900
Hot Total Failures:        0
Hot Average Latency:       0.322442 seconds
Hot Min Latency:           0.113985000 seconds
Hot Max Latency:           1.186796000 seconds

### Round 2
Cold Total Requests:       72
Cold Total Failures:       0
Cold Average Latency:      6.52888 seconds
Cold Min Latency:          5.540252000 seconds
Cold Max Latency:          7.255986000 seconds
Hot Total Requests:        900
Hot Total Failures:        0
Hot Average Latency:       0.337557 seconds
Hot Min Latency:           0.120338000 seconds
Hot Max Latency:           1.310212000 seconds

Variant 4 - CrtHttpClient / parameters

SAM Package size: 32.7344 MB (+ 17.9 MB in awssdk.crt.aws-crt-0.29.9)

Details 
### Round 1

Cold Total Requests:       100
Cold Total Failures:       0
Cold Average Latency:      6.26951 seconds
Cold Min Latency:          2.674017000 seconds
Cold Max Latency:          19.081645000 seconds
Hot Total Requests:        900
Hot Total Failures:        0
Hot Average Latency:       0.343371 seconds
Hot Min Latency:           0.085444000 seconds
Hot Max Latency:           1.622287000 seconds

### Round 2
Cold Total Requests:       100
Cold Total Failures:       0
Cold Average Latency:      6.11379 seconds
Cold Min Latency:          2.996530000 seconds
Cold Max Latency:          19.927326000 seconds
Hot Total Requests:        900
Hot Total Failures:        0
Hot Average Latency:       0.3329 seconds
Hot Min Latency:           0.082175000 seconds
Hot Max Latency:           1.821009000 seconds

Variant 6 - CrtHttpClient / Parameters / Stripped libraries

SAM Package size: 15.9 MB

Details 
### Round 1
Cold Total Requests:        100
Cold Total Failures:        0
Cold Average Latency:       4.68152 seconds
Cold Min Latency:           2.973330000 seconds
Cold Max Latency:           18.803892000 seconds
Hot Total Requests:         900
Hot Total Failures:         0
Hot Average Latency:        0.313844 seconds
Hot Min Latency:            0.094895000 seconds
Hot Max Latency:            1.652379000 seconds

### Round 2
Cold Total Requests:        100
Cold Total Failures:        0
Cold Average Latency:       4.21907 seconds
Cold Min Latency:           2.940657000 seconds
Cold Max Latency:           19.190015000 seconds
Hot Total Requests:         900
Hot Total Failures:         0
Hot Average Latency:        0.353127 seconds
Hot Min Latency:            0.084011000 seconds
Hot Max Latency:            1.756683000 seconds