sentry-android-gradle-plugin icon indicating copy to clipboard operation
sentry-android-gradle-plugin copied to clipboard

perf: Add startup time benchmarks for the instrumentation sample

Open romtsn opened this issue 3 years ago • 1 comments

Adds benchmark module to measure the startup time of the instrumentation sample app. It uses the same configuration as has been reported by one of our customers.

Options:

  • The benchmark ran on Pixel 3XL
  • Minified release build
  • Cold Start
  • 5 iterations

Results

With Sentry

image

Without Sentry

image

Only Sentry block

image

Which can conclude that on average the SDK adds 20-25ms to the app startup time.

The PR is not meant to be merged and can serve as prior art for the SDK overhead measurement Q2 goal. (Perhaps, we can move this sample app under the sentry-java repo, because it's a bit more complex than the samples there)

romtsn avatar May 17 '22 15:05 romtsn

Fails
:no_entry_sign: Please consider adding a changelog entry for the next release.

`Instructions and example for changelog`$

Please add an entry to CHANGELOG.md` to the "Unreleased" section under the following heading:

To the changelog entry, please add a link to this PR (consider a more descriptive message):`

- Add startup time benchmarks for the instrumentation sample(#317)

If none of the above apply, you can opt out by adding _#skip-changelog_ to the PR description.

Generated by :no_entry_sign: dangerJS against 3ca9c2a63e56e75f8ba9bb7030662d17abbbc53e

github-actions[bot] avatar May 17 '22 15:05 github-actions[bot]