per-profile directory for test output

[charala1]

To enable consecutive testing of different profiles, test output (.out, etc.) files are cleaned every time the tests are run.

This is necessary because these files are output into the same directory. We should output them into a different directory for each profile.

This would also allow testing different profiles in parallel.