CRNN-Keras icon indicating copy to clipboard operation
CRNN-Keras copied to clipboard

Training from pre-trained model weights.

Open Sreerag-ibtl opened this issue 6 years ago • 6 comments

The code uses VGG architecture for feature extraction. My doubt is that, is it possible to begin training from VGG weights?

Sreerag-ibtl avatar Feb 23 '19 08:02 Sreerag-ibtl

Initialization does not seem to matter.

Because I had trained the CRNN from scratch.

qjadud1994 avatar Feb 27 '19 03:02 qjadud1994

I tried CRNN with synthetic images of number plates. But the perfomance was poor on real images. So, I was wondering weather it is possible to do transfer learning with a smaller dataset that contains real images.

Sreerag-ibtl avatar Mar 07 '19 08:03 Sreerag-ibtl

Of course, if you train only with synthetic images, it is natural that it does not work properly in real images.

So, I recommend pre-training with synthetic images and fine-tune with real data.

If you have few real images, it might be worth trying to proceed by learning only the last few layers.

qjadud1994 avatar Mar 07 '19 08:03 qjadud1994

Do you have any suggestion about, upto which layer I should set the trainable flag False. Since there are many different layers involved and GRU layers are also present, I am little confused about this.

Sreerag-ibtl avatar Mar 09 '19 12:03 Sreerag-ibtl

Train all layers except pre-trained ones (VGG).

NikhilShaw avatar Jun 16 '19 08:06 NikhilShaw

Train all layers except pre-trained ones (VGG).

Can you please explain more ... ? How to do that ? Would you please show example code ? How to freeze those layers in model.py ? Thank you

centurions avatar Sep 12 '19 06:09 centurions