TensorFlowASR icon indicating copy to clipboard operation
TensorFlowASR copied to clipboard

Support multi-GPU training

Open gandroz opened this issue 4 years ago • 1 comments

It could be fun to support training over multi-GPU. The goal is not to increase the batch size but to increase the model size, so the model would have to be splitted over the GPUs rather than been duplicated.

gandroz avatar Jan 26 '21 14:01 gandroz

@gandroz I want this too, but according to the docs Screenshot from 2021-01-27 21-09-28 Spanning the model across devices is not supported yet.

nglehuy avatar Jan 27 '21 14:01 nglehuy