Multiprocessing / multiple workers on Windows

[Haydnspass]

On some Windows machines multiprocessing is unstable (I don't know why this is not reproducible though ...). Maybe we can improve this? Or it automatically improves by upgrading pytorch?

Resources:

https://stackoverflow.com/questions/18204782/runtimeerror-on-windows-trying-python-multiprocessing/18205006#18205006

https://discuss.pytorch.org/t/brokenpipeerror-errno-32-broken-pipe-when-i-run-cifar10-tutorial-py/6224/3

[Haydnspass]

I think bottomline:

• Add all package imports even though not needed there but later on under if name ...
• Add CLI for inference, also under if name ...

[Haydnspass]

Add functional test specifically testing this Run this test on all platforms by using a GitHub workflow