nmt-chatbot icon indicating copy to clipboard operation
nmt-chatbot copied to clipboard

Published 20 hours ago • verified publisher icon daniel-kukiela

How long should it take to train the demo model ?

Open Marwan-Mostafa7 opened this issue 6 years ago • 5 comments

it's been 4 days by now and still global step = 18400 ... How many steps are they ??

Marwan-Mostafa7 avatar Sep 07 '18 19:09 Marwan-Mostafa7

Are you training it on a CPU? Do you have Nvidia GPU? Demo model should be trained for couple of epochs, but won't be decent on that training data. Repository is set to train for 3 epochs.

daniel-kukiela avatar Sep 08 '18 04:09 daniel-kukiela

For the first time for me, it took 3 weeks and 2 days for all epoch on Paperspace server with 8 GB GPU and 32 GB CPU

sierikov avatar Sep 08 '18 19:09 sierikov

First - sorry for late reply. How much data are you using? Also are you sure you are using TF-GPU?

daniel-kukiela avatar Nov 03 '18 21:11 daniel-kukiela

Hi, Daniel.I am training it with my own data.my train.from and train.to files are like barely 700 mb.How long should it take with 1080 ti ? Thanks in advance

anonmanx avatar Dec 17 '18 13:12 anonmanx

Hello, Thank you for such a great tutorial. just a qq,

I have : CPU Cores: 16 RAM: 256GB GPU: 4x Nvidia Titan Xp 12GB (Pascal) machine and using reddit 2015-10 training set data. How long should training take take to complete the first time.

Also, is there a way to increase the speed of training ?

Thank you.

ankurgupta325 avatar Mar 15 '19 14:03 ankurgupta325