sentry-cocoa
sentry-cocoa copied to clipboard
getsentry
Test Apple Major OS releases 2024
Description
Description
iOS 18, tvOS 18, watchOS 11, macOS 15 are about to GA in September 2024. We should test whether our SDK works appropriately on these new OS versions.
Other tasks
### Must-have
- [ ] Test plan manual iOS+macOS/MacCatalyst
- [ ] Test plan check with customer data
- [ ] Test plan manual tvOS
- [ ] Test plan manual watchOS
### Optional / TBD
- [ ] https://github.com/getsentry/sentry-cocoa/issues/3105
- [ ] https://github.com/getsentry/sentry-cocoa/issues/3719
- [ ] https://github.com/getsentry/sentry-cocoa/issues/3103
- [ ] https://github.com/getsentry/sentry-cocoa/issues/3100
- [ ] https://github.com/getsentry/sentry-cocoa/issues/3104
Test plan manual test
| Feature | iOS | macOS | tvOS | MacCatalyst |
|---|---|---|---|---|
| Crashes with symbolication | ||||
| Error events with symbolication | ||||
| OOMs | 🚫 | 🚫 | ||
| App hangs | 🚫 | |||
| Release health | ||||
| View hierarchy | 🚫 | |||
| Screenshots | 🚫 | |||
| Auto-generated breadcrumbs | ||||
| Attachments | ||||
| App start | 🚫 | ☑️ | ||
| Slow & frozen frames | 🚫 | |||
| UIViewController tracking | 🚫 | |||
| TTID/TTFD | 🚫 | |||
| Network tracking | 🚫 | |||
| File I/O tracking | 🚫 | |||
| Core data tracking | 🚫 | ☑️ | ||
| User interaction tracking | 🚫 | |||
| Swift UI tracking | ||||
| MetricKit | ☑️ | |||
| Profiling | 🚫 | ☑️ |
🚫 = not available ☑️ = works on another platform. Not needed to put in the effort to test on this platform, because we are going to validate the feature with customer data. ✅ = tested successfully
Test plan check with customer data
Check features with customer data once iOS 17 is released. We only check iOS with customer data as things breaking there would have the most significant negative impact because we have, by far, the most projects on iOS. For the other platforms, the manual test above is sufficient.
| Feature | iOS |
|---|---|
| Crashes with symbolication | |
| Error events with symbolication | |
| OOMs | |
| App hangs | |
| Release health | |
| View hierarchy | |
| Screenshots | |
| Auto-generated breadcrumbs | |
| Attachments | |
| App start | |
| Slow & frozen frames | |
| UIViewController tracking | |
| TTID/TTFD | |
| Network tracking | |
| File I/O tracking | |
| Core data tracking | |
| User interaction tracking | |
| Swift UI tracking | |
| MetricKit | |
| Profiling |
Similar to https://github.com/getsentry/sentry-cocoa/issues/3129
