QANet icon indicating copy to clipboard operation
QANet copied to clipboard

How to train in Multi GPU

Open deepakkumar1984 opened this issue 6 years ago • 2 comments

I see that tensorflow detected 2 GPU's but the training is only happening in 1 GPU. Please advise?

deepakkumar1984 avatar Jun 15 '18 04:06 deepakkumar1984

It's not automatic. My 2 cents: look at this and figure out how you want to do it. https://www.tensorflow.org/programmers_guide/using_gpu#using_multiple_gpus

odellus avatar Jun 15 '18 10:06 odellus

Hi @deepakkumar1984 , multi-gpu training is not on my priority list, as SQuAD models usually train in a couple of hours with affordable gpus (gtx1070 etc). But I will definitely add it to the todo list for future work. Even better, a pull request and contributions are always welcome.

localminimum avatar Jun 24 '18 06:06 localminimum