Missing documentation for weight file and multi-reporter-config.json

[nils-hoyer]

I would love to see some documentation with an example of using a weight file correctely. Furthermore the multi-reporter-config.json file which pops up after execution is not documented at all.

[MayankArora20]

While running test cases, I know few of my test cases are heavy and few are light ones, if I could get a functionality to run all heavy ones in parallel, instead of random selection, that could help in reducing a lot of time. And if weight file could help in this, then it would be really great.

[lems3]

Digging trough the code, weights seems to go from the highest number to the lowest. Since the file is generated after each test, my understanding is that you need to always run the tests with the same number of threads to get any real benefits from it.

It is really nice for repeated tests as it makes them really faster. I have a couple of heavier tests in my suite, and once the file is generated, the run time is cut in half. It will depend on your test suite and how each test behave for you.

~~What I have not figured out for now is the imapct of the --weightsJson argument on the CLI. If it simply read the file and won't replace it, that would be how we can set a default weight file for our tests.~~

I did some digging, and the --weightJson file that you give to the argument will be replaced by a new file once the test are done. So you can send a file on your repo, but it will be overwritten. It may be OK in your current use case.