devices.xunit
devices.xunit copied to clipboard
Test Automation
Description
Device Test Automation is still a major pain point for the entire community. It would be fantastic to have a dotnet tool that could be installed and run that can install an IPA/APK to a simulator and establish communication with an included Writer so that test results can be captured for VS/Azure DevOps/etc...
@onovotny @dansiegel I was wondering if there is any traction on this? A proposed approach even? I agree this is a community problem that if we can solve, would be huge. I saw a video of James Montemagno sending in url's to a running iPhone app the other day. That has to be a step in the right direction.
I wish it was something I could take on right now but I have less than no time. I might point to the Xamarin.Essentials repo though as from what I understand they've automated their tests with device runners and the public hosted agents. It's really a matter of taking all of the script magic they're using and packaging it up to make it easy to reproduce for the entire community... then maybe get someone like @gotheap to help make it easy in the VS Test Explorer
I've been automating tests for iOS/android using a cake frosting add-on I wrote here: https://github.com/pellet/Cake.DevicesXunitTestReceiver . It writes the test results via tcp back to the cake job. It was just something to get me by until better tools came along with detailed reports. A VS/Rider Test explorer would be amazing for getting work done.
Hi!
Has anyone been able to configure test runs on Azure DevOps Mac agents for Xamarin.iOS projects? Is using a cake script the only feasible option for now?