jaywalnut310
Reduce RAM usage: remove excess workers
Leaving 8 workers lead to x8 times more RAM usage when preloading mel spectrograms, when it is not needed for single-process training.
It shouldn't be added to the official codebase, generally, people want to benefit from multiprocessing.
Have you looked into the commit? It changes hardcoded behaviour "I have 8 gpus, use 8 train loaders" to "I have N gpus, use N train loaders". I am sure most of people using this repo don't have 8 gpus and so much RAM for useless loader copies.
@nikich340 num_workers has nothing to do with the number of GPUs you have.
Ok, then there still should be a way to check if user really needs this, when every worker uses 4 gb of ram and it overfits real memory, using swap file give no benefit at all.