darts-multi_gpu Very slow when multi-gpu

Very slow when multi-gpu

Open YoungDav opened this issue 5 years ago • 1 comments

Environmental for requests numpy==1.15.4 graphviz==0.8.4 torch==1.0.0 torchvision==0.2.1 tensorboard==1.13.0 tensorboardX==1.6

when I use 8 gpus(GPU-Util about 4-9%), time will be very very slower than only use 1 gpu(origin code, GPU-Util about 30-90%)？

it is time perf line by line

Dec 07 '19 06:12 YoungDav

@YoungDav how about increase your batch size ?
https://github.com/quark0/darts/issues/37

Apr 12 '20 06:04 aaron851113