Skip to content

move more jobs to disk write #6156

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 4 commits into from
Aug 14, 2024
Merged

move more jobs to disk write #6156

merged 4 commits into from
Aug 14, 2024

Conversation

themiswang
Copy link
Contributor

@themiswang themiswang commented Aug 6, 2024

Move file clean up task to disk write worker.
Fix unit test: close session has to run on a background thread

Copy link
Contributor

github-actions bot commented Aug 6, 2024

Release note changes

No release note changes were detected. If you made changes that should be
present in the next release, ensure you've added an entry in the appropriate
CHANGELOG.md file(s).

@google-oss-bot
Copy link
Contributor

1 Warning
⚠️ Did you forget to add a changelog entry? (Add the 'no-changelog' label to the PR to silence this warning.)

Generated by 🚫 Danger

@google-oss-bot
Copy link
Contributor

google-oss-bot commented Aug 6, 2024

Coverage Report 1

Affected Products

  • firebase-crashlytics

    Overall coverage changed from 11.27% (9017c35) to 11.58% (5beb95a) by +0.31%.

    FilenameBase (9017c35)Merge (5beb95a)Diff
    CrashlyticsController.java16.18%18.42%+2.24%
    CrashlyticsWorker.java23.26%37.21%+13.95%
    CrashlyticsWorkers.kt26.32%57.89%+31.58%
    SessionReportingCoordinator.java42.44%41.71%-0.73%

Test Logs

  1. https://storage.googleapis.com/firebase-sdk-metric-reports/UTnltvLqX8.html

@themiswang themiswang force-pushed the moreTaskToDiskWrite branch 2 times, most recently from 1b91c64 to 3632e38 Compare August 6, 2024 03:07
@google-oss-bot
Copy link
Contributor

google-oss-bot commented Aug 6, 2024

Size Report 1

Affected Products

  • firebase-crashlytics

    TypeBase (9017c35)Merge (5beb95a)Diff
    aar410 kB410 kB+385 B (+0.1%)
    apk (aggressive)698 kB698 kB+100 B (+0.0%)
    apk (release)5.85 MB5.85 MB+820 B (+0.0%)

Test Logs

  1. https://storage.googleapis.com/firebase-sdk-metric-reports/eIjECeamKR.html

@google-oss-bot
Copy link
Contributor

google-oss-bot commented Aug 6, 2024

Startup Time Report 1

Note: Layout is sometimes suboptimal due to limited formatting support on GitHub. Please check this report on GCS.

Notes

Startup Times

  • fire-cls

    DeviceStatisticsDistributions
    oriole-32
    Percentile9017c355beb95aDiffSignificant (?)
    p1010.2 ±1 ms10.1 ±2 ms-89.1 μs (-0.9%)NO
    p2510.8 ±1 ms10.7 ±2 ms-105 μs (-1.0%)NO
    p5011.6 ±2 ms11.6 ±2 ms+36.6 μs (+0.3%)NO
    p7512.7 ±2 ms12.8 ±3 ms+151 μs (+1.2%)NO
    p9014.1 ±2 ms14.2 ±3 ms+42.1 μs (+0.3%)NO

    20 test runs in comparison
    CommitTest Runs
    9017c35
    • 2024-08-12_21:34:34.943821_zmot
    • 2024-08-12_21:34:34.943866_OhxB
    • 2024-08-12_21:34:34.943878_nLGG
    • 2024-08-12_21:34:34.943886_GyZj
    • 2024-08-12_21:34:34.943893_GaKs
    • 2024-08-12_21:34:34.943900_uMXJ
    • 2024-08-12_21:34:34.943907_iYXd
    • 2024-08-12_21:34:34.943913_zpyn
    • 2024-08-12_21:34:34.943920_rTIf
    • 2024-08-12_21:34:34.943927_UKWy
    5beb95a
    • 2024-08-13_23:24:55.185292_EUSZ
    • 2024-08-13_23:24:55.185339_FPcy
    • 2024-08-13_23:24:55.185348_xIIP
    • 2024-08-13_23:24:55.185355_tnRN
    • 2024-08-13_23:24:55.185361_hmef
    • 2024-08-13_23:24:55.185367_OYsE
    • 2024-08-13_23:24:55.185374_vHUm
    • 2024-08-13_23:24:55.185381_nwqb
    • 2024-08-13_23:24:55.185387_Tdhy
    • 2024-08-13_23:24:55.185393_mcrM
    redfin-30
    Percentile9017c355beb95aDiffSignificant (?)
    p1017.1 ±7 ms16.5 ±5 ms-662 μs (-3.9%)NO
    p2518.5 ±7 ms17.5 ±6 ms-924 μs (-5.0%)NO
    p5020.2 ±8 ms19.3 ±7 ms-939 μs (-4.6%)NO
    p7522.1 ±9.6 ms21.3 ±9 ms-805 μs (-3.6%)NO
    p9024.4 ±10 ms24.3 ±10 ms-151 μs (-0.6%)NO

    20 test runs in comparison
    CommitTest Runs
    9017c35
    • 2024-08-12_21:34:34.943821_zmot
    • 2024-08-12_21:34:34.943866_OhxB
    • 2024-08-12_21:34:34.943878_nLGG
    • 2024-08-12_21:34:34.943886_GyZj
    • 2024-08-12_21:34:34.943893_GaKs
    • 2024-08-12_21:34:34.943900_uMXJ
    • 2024-08-12_21:34:34.943907_iYXd
    • 2024-08-12_21:34:34.943913_zpyn
    • 2024-08-12_21:34:34.943920_rTIf
    • 2024-08-12_21:34:34.943927_UKWy
    5beb95a
    • 2024-08-13_23:24:55.185292_EUSZ
    • 2024-08-13_23:24:55.185339_FPcy
    • 2024-08-13_23:24:55.185348_xIIP
    • 2024-08-13_23:24:55.185355_tnRN
    • 2024-08-13_23:24:55.185361_hmef
    • 2024-08-13_23:24:55.185367_OYsE
    • 2024-08-13_23:24:55.185374_vHUm
    • 2024-08-13_23:24:55.185381_nwqb
    • 2024-08-13_23:24:55.185387_Tdhy
    • 2024-08-13_23:24:55.185393_mcrM
  • fire-rc

    DeviceStatisticsDistributions
    oriole-32
    Percentile9017c355beb95aDiffSignificant (?)
    p10349 ±358 μs243 ±248 μs-105 μs (-30.2%)NO
    p25364 ±367 μs257 ±257 μs-107 μs (-29.3%)NO
    p50391 ±383 μs280 ±266 μs-111 μs (-28.5%)NO
    p75421 ±397 μs333 ±279 μs-87.9 μs (-20.9%)NO
    p90483 ±422 μs425 ±328 μs-58.2 μs (-12.0%)NO

    20 test runs in comparison
    CommitTest Runs
    9017c35
    • 2024-08-12_21:34:34.943821_zmot
    • 2024-08-12_21:34:34.943866_OhxB
    • 2024-08-12_21:34:34.943878_nLGG
    • 2024-08-12_21:34:34.943886_GyZj
    • 2024-08-12_21:34:34.943893_GaKs
    • 2024-08-12_21:34:34.943900_uMXJ
    • 2024-08-12_21:34:34.943907_iYXd
    • 2024-08-12_21:34:34.943913_zpyn
    • 2024-08-12_21:34:34.943920_rTIf
    • 2024-08-12_21:34:34.943927_UKWy
    5beb95a
    • 2024-08-13_23:24:55.185292_EUSZ
    • 2024-08-13_23:24:55.185339_FPcy
    • 2024-08-13_23:24:55.185348_xIIP
    • 2024-08-13_23:24:55.185355_tnRN
    • 2024-08-13_23:24:55.185361_hmef
    • 2024-08-13_23:24:55.185367_OYsE
    • 2024-08-13_23:24:55.185374_vHUm
    • 2024-08-13_23:24:55.185381_nwqb
    • 2024-08-13_23:24:55.185387_Tdhy
    • 2024-08-13_23:24:55.185393_mcrM
    redfin-30
    Percentile9017c355beb95aDiffSignificant (?)
    p10547 ±644 μs664 ±727 μs+117 μs (+21.4%)NO
    p25632 ±776 μs767 ±874 μs+135 μs (+21.4%)NO
    p50742 ±937 μs882 ±1024 μs+140 μs (+18.9%)NO
    p75865 ±1102 μs1.06 ±1 ms+191 μs (+22.1%)NO
    p901.01 ±1 ms1.29 ±1 ms+284 μs (+28.3%)NO

    20 test runs in comparison
    CommitTest Runs
    9017c35
    • 2024-08-12_21:34:34.943821_zmot
    • 2024-08-12_21:34:34.943866_OhxB
    • 2024-08-12_21:34:34.943878_nLGG
    • 2024-08-12_21:34:34.943886_GyZj
    • 2024-08-12_21:34:34.943893_GaKs
    • 2024-08-12_21:34:34.943900_uMXJ
    • 2024-08-12_21:34:34.943907_iYXd
    • 2024-08-12_21:34:34.943913_zpyn
    • 2024-08-12_21:34:34.943920_rTIf
    • 2024-08-12_21:34:34.943927_UKWy
    5beb95a
    • 2024-08-13_23:24:55.185292_EUSZ
    • 2024-08-13_23:24:55.185339_FPcy
    • 2024-08-13_23:24:55.185348_xIIP
    • 2024-08-13_23:24:55.185355_tnRN
    • 2024-08-13_23:24:55.185361_hmef
    • 2024-08-13_23:24:55.185367_OYsE
    • 2024-08-13_23:24:55.185374_vHUm
    • 2024-08-13_23:24:55.185381_nwqb
    • 2024-08-13_23:24:55.185387_Tdhy
    • 2024-08-13_23:24:55.185393_mcrM
  • fire-sessions

    DeviceStatisticsDistributions
    oriole-32
    Percentile9017c355beb95aDiffSignificant (?)
    p102.86 ±0.7 ms3.54 ±1 ms+679 μs (+23.7%)NO
    p253.04 ±0.7 ms3.82 ±2 ms+776 μs (+25.5%)NO
    p503.41 ±0.7 ms4.18 ±2 ms+770 μs (+22.6%)NO
    p754.08 ±0.7 ms4.85 ±2 ms+771 μs (+18.9%)NO
    p904.88 ±0.8 ms5.83 ±2 ms+957 μs (+19.6%)NO

    20 test runs in comparison
    CommitTest Runs
    9017c35
    • 2024-08-12_21:34:34.943821_zmot
    • 2024-08-12_21:34:34.943866_OhxB
    • 2024-08-12_21:34:34.943878_nLGG
    • 2024-08-12_21:34:34.943886_GyZj
    • 2024-08-12_21:34:34.943893_GaKs
    • 2024-08-12_21:34:34.943900_uMXJ
    • 2024-08-12_21:34:34.943907_iYXd
    • 2024-08-12_21:34:34.943913_zpyn
    • 2024-08-12_21:34:34.943920_rTIf
    • 2024-08-12_21:34:34.943927_UKWy
    5beb95a
    • 2024-08-13_23:24:55.185292_EUSZ
    • 2024-08-13_23:24:55.185339_FPcy
    • 2024-08-13_23:24:55.185348_xIIP
    • 2024-08-13_23:24:55.185355_tnRN
    • 2024-08-13_23:24:55.185361_hmef
    • 2024-08-13_23:24:55.185367_OYsE
    • 2024-08-13_23:24:55.185374_vHUm
    • 2024-08-13_23:24:55.185381_nwqb
    • 2024-08-13_23:24:55.185387_Tdhy
    • 2024-08-13_23:24:55.185393_mcrM
    redfin-30
    Percentile9017c355beb95aDiffSignificant (?)
    p106.12 ±1 ms6.18 ±1 ms+55.5 μs (+0.9%)NO
    p256.58 ±2 ms6.70 ±1 ms+125 μs (+1.9%)NO
    p507.26 ±3 ms7.70 ±2 ms+448 μs (+6.2%)NO
    p757.93 ±4 ms8.76 ±4 ms+834 μs (+10.5%)NO
    p908.57 ±4 ms10.1 ±5 ms+1.55 ms (+18.0%)NO

    20 test runs in comparison
    CommitTest Runs
    9017c35
    • 2024-08-12_21:34:34.943821_zmot
    • 2024-08-12_21:34:34.943866_OhxB
    • 2024-08-12_21:34:34.943878_nLGG
    • 2024-08-12_21:34:34.943886_GyZj
    • 2024-08-12_21:34:34.943893_GaKs
    • 2024-08-12_21:34:34.943900_uMXJ
    • 2024-08-12_21:34:34.943907_iYXd
    • 2024-08-12_21:34:34.943913_zpyn
    • 2024-08-12_21:34:34.943920_rTIf
    • 2024-08-12_21:34:34.943927_UKWy
    5beb95a
    • 2024-08-13_23:24:55.185292_EUSZ
    • 2024-08-13_23:24:55.185339_FPcy
    • 2024-08-13_23:24:55.185348_xIIP
    • 2024-08-13_23:24:55.185355_tnRN
    • 2024-08-13_23:24:55.185361_hmef
    • 2024-08-13_23:24:55.185367_OYsE
    • 2024-08-13_23:24:55.185374_vHUm
    • 2024-08-13_23:24:55.185381_nwqb
    • 2024-08-13_23:24:55.185387_Tdhy
    • 2024-08-13_23:24:55.185393_mcrM
  • timeToInitialDisplay

    DeviceStatisticsDistributions
    oriole-32
    Percentile9017c355beb95aDiffSignificant (?)
    p10201 ±5 ms214 ±24 ms+12.9 ms (+6.4%)NO
    p25207 ±6 ms220 ±26 ms+13.1 ms (+6.3%)NO
    p50215 ±6 ms229 ±29 ms+14.4 ms (+6.7%)NO
    p75222 ±5 ms240 ±34 ms+17.4 ms (+7.8%)NO
    p90230 ±6 ms253 ±36 ms+22.3 ms (+9.7%)NO

    20 test runs in comparison
    CommitTest Runs
    9017c35
    • 2024-08-12_21:34:34.943821_zmot
    • 2024-08-12_21:34:34.943866_OhxB
    • 2024-08-12_21:34:34.943878_nLGG
    • 2024-08-12_21:34:34.943886_GyZj
    • 2024-08-12_21:34:34.943893_GaKs
    • 2024-08-12_21:34:34.943900_uMXJ
    • 2024-08-12_21:34:34.943907_iYXd
    • 2024-08-12_21:34:34.943913_zpyn
    • 2024-08-12_21:34:34.943920_rTIf
    • 2024-08-12_21:34:34.943927_UKWy
    5beb95a
    • 2024-08-13_23:24:55.185292_EUSZ
    • 2024-08-13_23:24:55.185339_FPcy
    • 2024-08-13_23:24:55.185348_xIIP
    • 2024-08-13_23:24:55.185355_tnRN
    • 2024-08-13_23:24:55.185361_hmef
    • 2024-08-13_23:24:55.185367_OYsE
    • 2024-08-13_23:24:55.185374_vHUm
    • 2024-08-13_23:24:55.185381_nwqb
    • 2024-08-13_23:24:55.185387_Tdhy
    • 2024-08-13_23:24:55.185393_mcrM
    redfin-30
    Percentile9017c355beb95aDiffSignificant (?)
    p10242 ±3 ms265 ±5 ms+23.1 ms (+9.6%)MAYBE
    p25248 ±3 ms271 ±5 ms+23.7 ms (+9.6%)MAYBE
    p50254 ±4 ms278 ±7 ms+24.4 ms (+9.6%)MAYBE
    p75262 ±4 ms288 ±7 ms+26.3 ms (+10.1%)MAYBE
    p90272 ±8 ms303 ±12 ms+31.0 ms (+11.4%)NO

    20 test runs in comparison
    CommitTest Runs
    9017c35
    • 2024-08-12_21:34:34.943821_zmot
    • 2024-08-12_21:34:34.943866_OhxB
    • 2024-08-12_21:34:34.943878_nLGG
    • 2024-08-12_21:34:34.943886_GyZj
    • 2024-08-12_21:34:34.943893_GaKs
    • 2024-08-12_21:34:34.943900_uMXJ
    • 2024-08-12_21:34:34.943907_iYXd
    • 2024-08-12_21:34:34.943913_zpyn
    • 2024-08-12_21:34:34.943920_rTIf
    • 2024-08-12_21:34:34.943927_UKWy
    5beb95a
    • 2024-08-13_23:24:55.185292_EUSZ
    • 2024-08-13_23:24:55.185339_FPcy
    • 2024-08-13_23:24:55.185348_xIIP
    • 2024-08-13_23:24:55.185355_tnRN
    • 2024-08-13_23:24:55.185361_hmef
    • 2024-08-13_23:24:55.185367_OYsE
    • 2024-08-13_23:24:55.185374_vHUm
    • 2024-08-13_23:24:55.185381_nwqb
    • 2024-08-13_23:24:55.185387_Tdhy
    • 2024-08-13_23:24:55.185393_mcrM

  1. https://storage.googleapis.com/firebase-sdk-metric-reports/5h9wm3coSW/index.html

@themiswang themiswang force-pushed the moreTaskToDiskWrite branch from 9d32d27 to aae872c Compare August 6, 2024 19:33
@themiswang themiswang marked this pull request as ready for review August 6, 2024 19:36
Copy link
Contributor

github-actions bot commented Aug 6, 2024

Unit Test Results

  8 files  +  4    8 suites  +4   26s ⏱️ +23s
22 tests  - 28  22 ✔️  - 28  0 💤 ±0  0 ±0 
44 runs   - 56  44 ✔️  - 56  0 💤 ±0  0 ±0 

Results for commit c4bdb31. ± Comparison against base commit 9017c35.

This pull request removes 50 and adds 22 tests. Note that renamed tests count towards both.
com.google.firebase.vertexai.StreamingSnapshotTests ‑ citation parsed correctly
com.google.firebase.vertexai.StreamingSnapshotTests ‑ empty content
com.google.firebase.vertexai.StreamingSnapshotTests ‑ http errors
com.google.firebase.vertexai.StreamingSnapshotTests ‑ image rejected
com.google.firebase.vertexai.StreamingSnapshotTests ‑ invalid api key
com.google.firebase.vertexai.StreamingSnapshotTests ‑ invalid json
com.google.firebase.vertexai.StreamingSnapshotTests ‑ long reply
com.google.firebase.vertexai.StreamingSnapshotTests ‑ malformed content
com.google.firebase.vertexai.StreamingSnapshotTests ‑ prompt blocked for safety
com.google.firebase.vertexai.StreamingSnapshotTests ‑ quotes escaped
…
com.google.firebase.crashlytics.internal.common.CrashlyticsControllerRobolectricTest ‑ testDoCloseSession_disabledAnrs_doesNotPersistsAppExitInfo
com.google.firebase.crashlytics.internal.common.CrashlyticsControllerRobolectricTest ‑ testDoCloseSession_enabledAnrs_doesNotPersistsAppExitInfoIfItDoesntExist
com.google.firebase.crashlytics.internal.common.CrashlyticsControllerRobolectricTest ‑ testDoCloseSession_enabledAnrs_persistsAppExitInfoIfItExists
com.google.firebase.crashlytics.internal.common.DataCollectionArbiterRobolectricTest ‑ testDefaultDataCollection_usedWhenNoOverrideOrManifestSetting
com.google.firebase.crashlytics.internal.common.DataCollectionArbiterRobolectricTest ‑ testManifestMetadata_respectedWhenNoOverride
com.google.firebase.crashlytics.internal.common.DataCollectionArbiterRobolectricTest ‑ testSetCrashlyticsDataCollectionEnabled_overridesOtherSettings
com.google.firebase.crashlytics.internal.common.SessionReportingCoordinatorRobolectricTest ‑ testAppExitInfoEvent_notPersistIfAnrBeforeSession
com.google.firebase.crashlytics.internal.common.SessionReportingCoordinatorRobolectricTest ‑ testAppExitInfoEvent_notPersistIfAppExitInfoNotAnrButWithinSession
com.google.firebase.crashlytics.internal.common.SessionReportingCoordinatorRobolectricTest ‑ testAppExitInfoEvent_persistIfAnrWithinSession
com.google.firebase.crashlytics.internal.common.SessionReportingCoordinatorRobolectricTest ‑ testAppExitInfoEvent_persistIfAnrWithinSession_multipleAppExitInfo
…

♻️ This comment has been updated with latest results.

@themiswang themiswang force-pushed the moreTaskToDiskWrite branch 5 times, most recently from 102cacf to c4bdb31 Compare August 13, 2024 21:26
@themiswang themiswang force-pushed the moreTaskToDiskWrite branch from c4bdb31 to 54275a2 Compare August 13, 2024 23:12
@themiswang themiswang merged commit db42bae into main Aug 14, 2024
41 of 42 checks passed
@themiswang themiswang deleted the moreTaskToDiskWrite branch August 14, 2024 02:46
mrober added a commit that referenced this pull request Aug 19, 2024
@firebase firebase locked and limited conversation to collaborators Sep 14, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants