LOTClass icon indicating copy to clipboard operation
LOTClass copied to clipboard

Can I train on cpu and control layer freezing ?

Open Faisal-Hajari opened this issue 1 year ago • 1 comments

Faisal-Hajari avatar Oct 03 '22 06:10 Faisal-Hajari

Hi,

While it's possible to freeze most layers to save computation and make it possible to train on CPUs, it's not recommended to do so -- the hyperparameters (e.g., learning rate, batch size) will need to be re-tuned and there's no guarantee on how well the trained model will be. It's probably better to seek for GPU resources like Google Colab.

Best, Yu

yumeng5 avatar Oct 03 '22 17:10 yumeng5