devices.xunit icon indicating copy to clipboard operation
devices.xunit copied to clipboard

Test Automation

Open dansiegel opened this issue 5 years ago • 4 comments

Description

Device Test Automation is still a major pain point for the entire community. It would be fantastic to have a dotnet tool that could be installed and run that can install an IPA/APK to a simulator and establish communication with an included Writer so that test results can be captured for VS/Azure DevOps/etc...

dansiegel avatar Nov 13 '18 03:11 dansiegel

@onovotny @dansiegel I was wondering if there is any traction on this? A proposed approach even? I agree this is a community problem that if we can solve, would be huge. I saw a video of James Montemagno sending in url's to a running iPhone app the other day. That has to be a step in the right direction.

RLittlesII avatar Apr 23 '19 15:04 RLittlesII

I wish it was something I could take on right now but I have less than no time. I might point to the Xamarin.Essentials repo though as from what I understand they've automated their tests with device runners and the public hosted agents. It's really a matter of taking all of the script magic they're using and packaging it up to make it easy to reproduce for the entire community... then maybe get someone like @gotheap to help make it easy in the VS Test Explorer

dansiegel avatar Apr 23 '19 15:04 dansiegel

I've been automating tests for iOS/android using a cake frosting add-on I wrote here: https://github.com/pellet/Cake.DevicesXunitTestReceiver . It writes the test results via tcp back to the cake job. It was just something to get me by until better tools came along with detailed reports. A VS/Rider Test explorer would be amazing for getting work done.

pellet avatar Jul 07 '19 14:07 pellet

Hi!

Has anyone been able to configure test runs on Azure DevOps Mac agents for Xamarin.iOS projects? Is using a cake script the only feasible option for now?

LDan1117 avatar Apr 19 '21 16:04 LDan1117