Isolated mode: run tests in parallel

[virtuald]

pytest-xdist can do it, so can we?

The reason we aren't using pytest-xdist is that it doesn't have a way to limit the number of simultaneous tests and have each test be running in its own process.