SeleniumGrid-like feature for paralellizing tests?

[tdrury]

We have about 700 soapUI tests in about 50 soapUI project files. They take a couple hours to run. But there is no reason why projects cannot be executed in parallel. After reading how SeleniumGrid works, it would be a compelling feature to add this for soapUI. It's probably beyond the scope of the maven-soapui-extension-plugin project, but this would be a fun project to work on.

[redfish4ktc]

It could be any a nice feature to run tests in parallel, I am not to sure to have time to work on it but at least we can talk about it :smiley_cat:

Could you provide more details about what you have in mind? do you mean "scale by distributing tests on several machines ( parallel execution ) " (as described in the Selenium Grid wiki)? or being able to run tests in parallel on the same machine?

[tdrury]

I mean to spread the testing across machines. While you could try to paralellize on one machine, my experience has shown each test runner consumes a lot of heap. You would be pretty limited in the number of parallel test runners.

The idea would be to develop a hub application and client application. The client application only needs to know the URL to the hub. When it starts it registers itself with the hub. When the maven plugin runs, it collects all the soapui projects and configuration data and sends it to the hub. The hub distributes the soapui projects to registered clients which execute the test suites in the project it was given and sends the results back to the hub. The hub reports the results back to the maven plugin. Since it's often necessary to debug test failures by looking at the test step failure files, the client would probably need to zip its target folder up and return it as well.