Running tests on very large sets fails

[erunyon]

I attempted to run a test on a set of approximately 1,700 unique homepages. The process failed before completing the first run (running locally).

1. Do you have recommendations for running very large sets, or
2. Is there a way to run smaller sets and then combine the results to get a combined leader board?

Thanks

[nhoizey]

@erunyon do you have a specific error message to share?

Did you try to run the tests with just a few URLs, then add another group, and so on? With the options.frequency setting, if you run the tests frequently enough, only one of the groups should update at once.

[erunyon]

I tried running it on the large set first. Had to break it up into smaller sets. I haven't run it in quite a while. Feel free to close this Issue.