duorat
duorat copied to clipboard
Is it possible to run BERT Large with Multiple-GPUs?
Is it possible to run the BERT large version with multiple GPUs? For example, rather than have a single 32 GB gpu, I would like to use two 16 GB GPUs.
At the moment it is not possible. But we would welcome a pull request :) It should not be too hard to implement this.