duorat icon indicating copy to clipboard operation
duorat copied to clipboard

Is it possible to run BERT Large with Multiple-GPUs?

Open sanjayss34 opened this issue 5 years ago • 1 comments

Is it possible to run the BERT large version with multiple GPUs? For example, rather than have a single 32 GB gpu, I would like to use two 16 GB GPUs.

sanjayss34 avatar Oct 30 '20 23:10 sanjayss34

At the moment it is not possible. But we would welcome a pull request :) It should not be too hard to implement this.

rizar avatar Oct 31 '20 22:10 rizar