car-damage-detector icon indicating copy to clipboard operation
car-damage-detector copied to clipboard

Training for more than 12 hrs and still not completed

Open aronvel opened this issue 6 years ago • 2 comments

screenshot 430 The training is going on for hrs and still going. To be precise u said it would take approx 4mins for each epoch , but for me its 3 hrs 30 mins for each epoch , so after 12 hrs only 4 epoch completed... Guide me with this issue. thanks

aronvel avatar Jan 28 '19 03:01 aronvel

Hi Aron,

Are you using Google Colab? I run my tests with their NVIDIA K80.

Regards, N

nicolasmetallo avatar Jan 31 '19 13:01 nicolasmetallo

You need to use better GPU or use EC2 sagemaker or Google Colab, both will cost though

achieverprince avatar Jan 07 '20 12:01 achieverprince