Test Apple Major OS 2022 Releases
Description
On September 7th, Apple has scheduled an event, which means that iOS 16, tvOS 16, watchOS 9, and macOS 13 are about to GA. We should test if our SDK is still working properly on these new OS versions.
Test plan manual test
| Feature | iOS | macOS | tvOS | MacCatalyst |
|---|---|---|---|---|
| Crashes with symbolication | ✅ | ✅ | ✅ | ✅ |
| Error events with symbolication | ✅ | ✅ | ✅ | ✅ |
| OOMs | ✅ | ╳ | ☑️ | ╳ |
| App hangs | ✅ | ╳ | ✅ | ✅ |
| Release health | ✅ | ✅ | ✅ | ✅ |
| Auto-generated breadcrumbs | ✅ | ✅ | ✅ | ✅ |
| Attachments | ✅ | ✅ | ✅ | ✅ |
| App start | ✅ | ╳ | ☑️ | ✅ |
| Slow & frozen frames | ✅ | ╳ | ✅ | ✅ |
| UIViewController tracking | ✅ | ╳ | ☑️ | ✅ |
| Network tracking | ✅ | ╳ | ✅ | ✅ |
| File I/O tracking | ✅ | ╳ | ✅ | ✅ |
| Core data tracking | ✅ | ╳ | ☑️ | ✅ |
| User interaction tracking | ✅ | ╳ | ☑️ | ✅ |
╳ = not available ☑️ = works on another platform. Not needed to put in the effort to test on this platform, because we are going to validate the feature with customer data.
tvOS tested on the simulator because I can't update the tvOS yet, cause I need it for uploading dSYMs, and a tvOS 15.x bugfix could still be released, tvOS has a lower priority, and if something big would be broken, we should find the error with the simulator.
Test plan check with customer data
Check features with customer data once iOS 16 is released.
| Feature | iOS | macOS | tvOS | MacCatalyst | watchOS |
|---|---|---|---|---|---|
| Crashes with symbolication | |||||
| Error events with symbolication | |||||
| OOMs | |||||
| App hangs | |||||
| Release health | |||||
| Auto-generated breadcrumbs | |||||
| Attachments | |||||
| App start | |||||
| Slow & frozen frames | |||||
| UIViewController tracking | |||||
| Network tracking | |||||
| File I/O tracking | |||||
| Core data tracking | |||||
| User interaction tracking |
@brustolin, can you think of any other features that need testing? If so, please add them above.
This issue has gone three weeks without activity. In another week, I will close it.
But! If you comment or otherwise update it, I will reset the clock, and if you label it Status: Backlog or Status: In Progress, I will leave it alone ... forever!
"A weed is but an unloved flower." ― Ella Wheeler Wilcox 🥀
I finished testing; see above.