Bump e2e tests and sample apps to XCode 26
Open
alwx
opened this issue 3 weeks ago
•
4 comments
:loudspeaker: Type of change
- [ ] Bugfix
- [ ] New feature
- [x] Enhancement
- [ ] Refactoring
:scroll: Description
Fixes #5457
:bulb: Motivation and Context
:green_heart: How did you test it?
:pencil: Checklist
- [ ] I added tests to verify changes
- [x] No new PII added or SDK only sends newly added PII if
sendDefaultPII is enabled
- [ ] I updated the docs if needed.
- [ ] I updated the wizard if needed.
- [x] All tests passing
- [x] No breaking changes
:crystal_ball: Next steps
Dec 15
'25 09:12
alwx
Android (new) Performance metrics :rocket:
| |
Plain |
With Sentry |
Diff |
| Startup time |
377.64 ms |
398.41 ms |
20.77 ms |
| Size |
43.94 MiB |
48.91 MiB |
4.97 MiB |
Baseline results on branch: main
Startup times
| Revision |
Plain |
With Sentry |
Diff |
| 9b50d327b0e195bd7bdd9ac3125fefbb7756fb23+dirty |
429.59 ms |
423.89 ms |
-5.70 ms |
| d916aa34b63da8106b7fb7935c61c11508d19fbd+dirty |
411.72 ms |
451.76 ms |
40.03 ms |
| 3bd3f0d1eed352ad998355167fe8869e1f24f76a+dirty |
334.38 ms |
402.19 ms |
67.81 ms |
| 526494aba4e19d5931102d4ba5a53693c20a0852+dirty |
361.10 ms |
410.84 ms |
49.74 ms |
| af9331b0735c2037423a2dddf23b1e4571e58657+dirty |
374.42 ms |
425.68 ms |
51.26 ms |
| 5602cc4ff9111bd0b5c69413c06063c08e625573+dirty |
374.87 ms |
396.74 ms |
21.87 ms |
| b7aa1aa6542ad675b92ff9f59ef0aece42496e20+dirty |
281.02 ms |
317.53 ms |
36.51 ms |
| 4604da9f137c1d57471b519b24498849e5d7e522+dirty |
292.27 ms |
314.16 ms |
21.90 ms |
| c1573b3e1a463de42fd972bb6279038f8e58dfa3+dirty |
355.65 ms |
448.82 ms |
93.17 ms |
| 185371059376cc53d3bcecc18bcc8d01d66bdda8+dirty |
360.67 ms |
396.28 ms |
35.61 ms |
App size
| Revision |
Plain |
With Sentry |
Diff |
| 9b50d327b0e195bd7bdd9ac3125fefbb7756fb23+dirty |
43.94 MiB |
48.87 MiB |
4.93 MiB |
| d916aa34b63da8106b7fb7935c61c11508d19fbd+dirty |
7.15 MiB |
8.42 MiB |
1.27 MiB |
| 3bd3f0d1eed352ad998355167fe8869e1f24f76a+dirty |
7.15 MiB |
8.43 MiB |
1.28 MiB |
| 526494aba4e19d5931102d4ba5a53693c20a0852+dirty |
43.94 MiB |
48.82 MiB |
4.88 MiB |
| af9331b0735c2037423a2dddf23b1e4571e58657+dirty |
7.15 MiB |
8.41 MiB |
1.26 MiB |
| 5602cc4ff9111bd0b5c69413c06063c08e625573+dirty |
43.94 MiB |
48.90 MiB |
4.96 MiB |
| b7aa1aa6542ad675b92ff9f59ef0aece42496e20+dirty |
7.15 MiB |
8.46 MiB |
1.31 MiB |
| 4604da9f137c1d57471b519b24498849e5d7e522+dirty |
7.15 MiB |
8.46 MiB |
1.31 MiB |
| c1573b3e1a463de42fd972bb6279038f8e58dfa3+dirty |
7.15 MiB |
8.42 MiB |
1.27 MiB |
| 185371059376cc53d3bcecc18bcc8d01d66bdda8+dirty |
7.15 MiB |
8.41 MiB |
1.26 MiB |
Previous results on branch: alwx/improvement/macos26
Startup times
| Revision |
Plain |
With Sentry |
Diff |
| 7a8efc9d65b35bbb7e2cb035db68af8b7b0811af+dirty |
431.82 ms |
479.52 ms |
47.70 ms |
| 4928c5f21388ee6b079e55da1d155f5d62d74929+dirty |
361.54 ms |
373.70 ms |
12.16 ms |
| 89412e2ee1285487067666680ee606a75b6aff6d+dirty |
367.89 ms |
390.24 ms |
22.35 ms |
App size
| Revision |
Plain |
With Sentry |
Diff |
| 7a8efc9d65b35bbb7e2cb035db68af8b7b0811af+dirty |
43.94 MiB |
48.90 MiB |
4.96 MiB |
| 4928c5f21388ee6b079e55da1d155f5d62d74929+dirty |
43.94 MiB |
48.90 MiB |
4.96 MiB |
| 89412e2ee1285487067666680ee606a75b6aff6d+dirty |
43.94 MiB |
48.90 MiB |
4.96 MiB |
Android (legacy) Performance metrics :rocket:
| |
Plain |
With Sentry |
Diff |
| Startup time |
386.51 ms |
438.18 ms |
51.67 ms |
| Size |
43.75 MiB |
48.08 MiB |
4.33 MiB |
Baseline results on branch: main
Startup times
| Revision |
Plain |
With Sentry |
Diff |
| 9b50d327b0e195bd7bdd9ac3125fefbb7756fb23+dirty |
455.51 ms |
466.56 ms |
11.05 ms |
| 8d89cc9441fd84dd76a69fc92d0c90c10467bf78+dirty |
537.83 ms |
536.02 ms |
-1.81 ms |
| 07808fba67805f52ded1ad55bfe94c1b5a56a1c1+dirty |
419.10 ms |
419.08 ms |
-0.02 ms |
| 526494aba4e19d5931102d4ba5a53693c20a0852+dirty |
422.80 ms |
438.90 ms |
16.10 ms |
| 8490686deff04f5c330c45c33bcf1abeb838164b+dirty |
365.59 ms |
400.24 ms |
34.65 ms |
| 69602ce581339ab9271cb7a1d8f157728482f74c |
417.47 ms |
443.52 ms |
26.05 ms |
| 5602cc4ff9111bd0b5c69413c06063c08e625573+dirty |
419.91 ms |
439.52 ms |
19.61 ms |
| b7aa1aa6542ad675b92ff9f59ef0aece42496e20+dirty |
324.73 ms |
327.76 ms |
3.03 ms |
| 122666437b1474661a7787a95a8d79e53aa8be63+dirty |
347.45 ms |
386.60 ms |
39.15 ms |
| a31630cb8451580d2d68ac8d8b4f155e4e2a0032+dirty |
408.91 ms |
416.80 ms |
7.89 ms |
App size
| Revision |
Plain |
With Sentry |
Diff |
| 9b50d327b0e195bd7bdd9ac3125fefbb7756fb23+dirty |
43.75 MiB |
48.04 MiB |
4.29 MiB |
| 8d89cc9441fd84dd76a69fc92d0c90c10467bf78+dirty |
17.75 MiB |
19.68 MiB |
1.94 MiB |
| 07808fba67805f52ded1ad55bfe94c1b5a56a1c1+dirty |
17.75 MiB |
19.70 MiB |
1.95 MiB |
| 526494aba4e19d5931102d4ba5a53693c20a0852+dirty |
43.75 MiB |
47.99 MiB |
4.24 MiB |
| 8490686deff04f5c330c45c33bcf1abeb838164b+dirty |
17.75 MiB |
19.70 MiB |
1.96 MiB |
| 69602ce581339ab9271cb7a1d8f157728482f74c |
17.75 MiB |
19.68 MiB |
1.94 MiB |
| 5602cc4ff9111bd0b5c69413c06063c08e625573+dirty |
43.75 MiB |
48.07 MiB |
4.32 MiB |
| b7aa1aa6542ad675b92ff9f59ef0aece42496e20+dirty |
17.75 MiB |
19.75 MiB |
2.00 MiB |
| 122666437b1474661a7787a95a8d79e53aa8be63+dirty |
17.75 MiB |
19.74 MiB |
1.99 MiB |
| a31630cb8451580d2d68ac8d8b4f155e4e2a0032+dirty |
17.75 MiB |
19.68 MiB |
1.94 MiB |
Previous results on branch: alwx/improvement/macos26
Startup times
| Revision |
Plain |
With Sentry |
Diff |
| 7a8efc9d65b35bbb7e2cb035db68af8b7b0811af+dirty |
418.15 ms |
428.90 ms |
10.76 ms |
| 4928c5f21388ee6b079e55da1d155f5d62d74929+dirty |
406.29 ms |
426.00 ms |
19.71 ms |
| 89412e2ee1285487067666680ee606a75b6aff6d+dirty |
435.63 ms |
494.98 ms |
59.35 ms |
App size
| Revision |
Plain |
With Sentry |
Diff |
| 7a8efc9d65b35bbb7e2cb035db68af8b7b0811af+dirty |
43.75 MiB |
48.07 MiB |
4.32 MiB |
| 4928c5f21388ee6b079e55da1d155f5d62d74929+dirty |
43.75 MiB |
48.07 MiB |
4.32 MiB |
| 89412e2ee1285487067666680ee606a75b6aff6d+dirty |
43.75 MiB |
48.07 MiB |
4.32 MiB |
iOS (new) Performance metrics :rocket:
| |
Plain |
With Sentry |
Diff |
| Startup time |
1223.98 ms |
1222.06 ms |
-1.92 ms |
| Size |
3.44 MiB |
4.59 MiB |
1.15 MiB |
Baseline results on branch: main
Startup times
| Revision |
Plain |
With Sentry |
Diff |
| 0d6e618074d46f9e4c94c28d3dd66483c7047ef2+dirty |
1191.59 ms |
1190.35 ms |
-1.24 ms |
| 6bd905428177d543b0413f97b92c47940169f16d+dirty |
1207.02 ms |
1199.27 ms |
-7.76 ms |
| 21c9e756985e1b5e4c0c65d1bb24c5fa2ad6f63e+dirty |
1206.20 ms |
1223.54 ms |
17.35 ms |
| 1bea09572f0d8d9a10acd27bd1b25bf9a953b836+dirty |
1218.93 ms |
1212.37 ms |
-6.57 ms |
| 083f560c367e99fa4dfa95d7499a8e4b98425c29+dirty |
1215.27 ms |
1231.96 ms |
16.69 ms |
| a3f32911800ca7b5ec0d641e9471e581b88d3b9b+dirty |
1206.37 ms |
1208.44 ms |
2.08 ms |
| 8d89cc9441fd84dd76a69fc92d0c90c10467bf78+dirty |
1232.35 ms |
1228.53 ms |
-3.82 ms |
| df83aada0dcb25d62da9682aca1da6d3f2af9ff4+dirty |
1202.06 ms |
1203.83 ms |
1.77 ms |
| 185371059376cc53d3bcecc18bcc8d01d66bdda8+dirty |
1213.67 ms |
1226.35 ms |
12.67 ms |
| a2bb688d8e9af7ef26305bb8e150beb91fa28df2+dirty |
1244.82 ms |
1238.60 ms |
-6.22 ms |
App size
| Revision |
Plain |
With Sentry |
Diff |
| 0d6e618074d46f9e4c94c28d3dd66483c7047ef2+dirty |
3.41 MiB |
4.58 MiB |
1.17 MiB |
| 6bd905428177d543b0413f97b92c47940169f16d+dirty |
3.41 MiB |
4.67 MiB |
1.25 MiB |
| 21c9e756985e1b5e4c0c65d1bb24c5fa2ad6f63e+dirty |
3.19 MiB |
4.38 MiB |
1.19 MiB |
| 1bea09572f0d8d9a10acd27bd1b25bf9a953b836+dirty |
3.19 MiB |
4.55 MiB |
1.37 MiB |
| 083f560c367e99fa4dfa95d7499a8e4b98425c29+dirty |
3.19 MiB |
4.56 MiB |
1.38 MiB |
| a3f32911800ca7b5ec0d641e9471e581b88d3b9b+dirty |
3.41 MiB |
4.66 MiB |
1.25 MiB |
| 8d89cc9441fd84dd76a69fc92d0c90c10467bf78+dirty |
3.19 MiB |
4.53 MiB |
1.35 MiB |
| df83aada0dcb25d62da9682aca1da6d3f2af9ff4+dirty |
3.41 MiB |
4.57 MiB |
1.16 MiB |
| 185371059376cc53d3bcecc18bcc8d01d66bdda8+dirty |
3.19 MiB |
4.48 MiB |
1.29 MiB |
| a2bb688d8e9af7ef26305bb8e150beb91fa28df2+dirty |
3.19 MiB |
4.56 MiB |
1.37 MiB |
Previous results on branch: alwx/improvement/macos26
Startup times
| Revision |
Plain |
With Sentry |
Diff |
| 89412e2ee1285487067666680ee606a75b6aff6d+dirty |
1211.14 ms |
1214.69 ms |
3.54 ms |
| 7a8efc9d65b35bbb7e2cb035db68af8b7b0811af+dirty |
1217.68 ms |
1217.21 ms |
-0.47 ms |
| 4928c5f21388ee6b079e55da1d155f5d62d74929+dirty |
1214.41 ms |
1214.84 ms |
0.44 ms |
App size
| Revision |
Plain |
With Sentry |
Diff |
| 89412e2ee1285487067666680ee606a75b6aff6d+dirty |
3.38 MiB |
4.58 MiB |
1.21 MiB |
| 7a8efc9d65b35bbb7e2cb035db68af8b7b0811af+dirty |
3.38 MiB |
4.58 MiB |
1.21 MiB |
| 4928c5f21388ee6b079e55da1d155f5d62d74929+dirty |
3.41 MiB |
4.58 MiB |
1.17 MiB |
iOS (legacy) Performance metrics :rocket:
| |
Plain |
With Sentry |
Diff |
| Startup time |
1219.71 ms |
1213.28 ms |
-6.43 ms |
| Size |
3.44 MiB |
4.59 MiB |
1.15 MiB |
Baseline results on branch: main
Startup times
| Revision |
Plain |
With Sentry |
Diff |
| 0d6e618074d46f9e4c94c28d3dd66483c7047ef2+dirty |
1226.16 ms |
1221.66 ms |
-4.50 ms |
| 6bd905428177d543b0413f97b92c47940169f16d+dirty |
1212.20 ms |
1217.89 ms |
5.70 ms |
| 21c9e756985e1b5e4c0c65d1bb24c5fa2ad6f63e+dirty |
1237.78 ms |
1247.66 ms |
9.88 ms |
| 1bea09572f0d8d9a10acd27bd1b25bf9a953b836+dirty |
1234.14 ms |
1233.96 ms |
-0.18 ms |
| 083f560c367e99fa4dfa95d7499a8e4b98425c29+dirty |
1227.33 ms |
1242.02 ms |
14.69 ms |
| a3f32911800ca7b5ec0d641e9471e581b88d3b9b+dirty |
1219.54 ms |
1217.40 ms |
-2.14 ms |
| 8d89cc9441fd84dd76a69fc92d0c90c10467bf78+dirty |
1222.92 ms |
1239.43 ms |
16.51 ms |
| df83aada0dcb25d62da9682aca1da6d3f2af9ff4+dirty |
1187.20 ms |
1190.55 ms |
3.36 ms |
| 185371059376cc53d3bcecc18bcc8d01d66bdda8+dirty |
1224.35 ms |
1230.18 ms |
5.84 ms |
| a2bb688d8e9af7ef26305bb8e150beb91fa28df2+dirty |
1223.53 ms |
1232.90 ms |
9.37 ms |
App size
| Revision |
Plain |
With Sentry |
Diff |
| 0d6e618074d46f9e4c94c28d3dd66483c7047ef2+dirty |
3.41 MiB |
4.58 MiB |
1.17 MiB |
| 6bd905428177d543b0413f97b92c47940169f16d+dirty |
3.41 MiB |
4.67 MiB |
1.25 MiB |
| 21c9e756985e1b5e4c0c65d1bb24c5fa2ad6f63e+dirty |
2.63 MiB |
3.81 MiB |
1.18 MiB |
| 1bea09572f0d8d9a10acd27bd1b25bf9a953b836+dirty |
2.63 MiB |
3.99 MiB |
1.35 MiB |
| 083f560c367e99fa4dfa95d7499a8e4b98425c29+dirty |
2.63 MiB |
4.00 MiB |
1.36 MiB |
| a3f32911800ca7b5ec0d641e9471e581b88d3b9b+dirty |
3.41 MiB |
4.66 MiB |
1.25 MiB |
| 8d89cc9441fd84dd76a69fc92d0c90c10467bf78+dirty |
2.63 MiB |
3.96 MiB |
1.33 MiB |
| df83aada0dcb25d62da9682aca1da6d3f2af9ff4+dirty |
3.41 MiB |
4.57 MiB |
1.16 MiB |
| 185371059376cc53d3bcecc18bcc8d01d66bdda8+dirty |
2.63 MiB |
3.91 MiB |
1.28 MiB |
| a2bb688d8e9af7ef26305bb8e150beb91fa28df2+dirty |
2.63 MiB |
3.99 MiB |
1.36 MiB |
Previous results on branch: alwx/improvement/macos26
Startup times
| Revision |
Plain |
With Sentry |
Diff |
| 89412e2ee1285487067666680ee606a75b6aff6d+dirty |
1198.16 ms |
1205.24 ms |
7.08 ms |
| 7a8efc9d65b35bbb7e2cb035db68af8b7b0811af+dirty |
1213.23 ms |
1215.02 ms |
1.79 ms |
| 4928c5f21388ee6b079e55da1d155f5d62d74929+dirty |
1224.66 ms |
1223.61 ms |
-1.05 ms |
App size
| Revision |
Plain |
With Sentry |
Diff |
| 89412e2ee1285487067666680ee606a75b6aff6d+dirty |
3.38 MiB |
4.58 MiB |
1.21 MiB |
| 7a8efc9d65b35bbb7e2cb035db68af8b7b0811af+dirty |
3.38 MiB |
4.58 MiB |
1.21 MiB |
| 4928c5f21388ee6b079e55da1d155f5d62d74929+dirty |
3.41 MiB |
4.58 MiB |
1.17 MiB |
getsentry
![github-actions[bot] avatar](https://avatars.githubusercontent.com/in/15368?v=4 "Published by a pub.dev verified publisher"){kind=small}