darts icon indicating copy to clipboard operation
darts copied to clipboard

Published 20 hours ago • verified publisher icon quark0

Training time on colab

Open pizhn opened this issue 3 years ago • 2 comments

When running train_search in colab pro using GPU, every epoch takes around 3100 secs. Then total 50 epochs takes around 1.8 days. Anybody trying colab how much training time do you need? Can you reproduce the 1 day searching time in paper?

pizhn avatar Jun 30 '21 19:06 pizhn

I realized I didn't copy my data in google drive to local env. I just added that in my workflow, but it only accelerates a little, seems still take 31 hrs or so

pizhn avatar Jul 01 '21 19:07 pizhn

When running MNIST ,i caculate each epoch consumes about 3000secs when i set batch size=16, which runs in 2080 10G gpu,and intel E5 2650 V4 CPU.I find that GPU utilize rate are very low ,around 8-25%,which makes me annoyed

myl11045 avatar Nov 03 '22 12:11 myl11045