Split tests in folders when it reaches thresshold

[sanderstad]

Opearting systems do not like it when you have more than 10,000 files in a single directory.

There needs to be a parameter (and preferably a check) that when the directory has a certain amount of files it splits it in directories.

Maybe even fore that to happen because the user may not know that so many objects are being created.