doctr icon indicating copy to clipboard operation
doctr copied to clipboard

[models] Complete the list of pretrained available models in TensorFlow and PyTorch

Open felixdittrich92 opened this issue 2 years ago • 3 comments

🚀 The feature

Ensure that each model has a pretrained available checkpoint

TensorFlow:

classification:

  • [x] ViT
  • [ ] MAGC
  • [ ] MobileNetV3 (will be updated soon)

detection:

  • [ ] DB_MobileNetV3 (after update)
  • [ ] LinkNet (all)

recognition:

  • [ ] CRNN (with mobilenet as bb after update)
  • [ ] SAR
  • [ ] MASTER

PyTorch:

classification:

  • [x] ViT
  • [ ] ResNet34_wide

detection:

  • [ ] DB_ResNet34
  • [ ] LinkNet (all)

recognition:

  • [ ] SAR
  • [ ] MASTER

Motivation, pitch

  • Users wants to test each available model and needs the pretrained versions to finetune on there own data

felixdittrich92 avatar Jun 30 '22 13:06 felixdittrich92

@charlesmindee i think you are the only one who can do it (data) :smiley:

felixdittrich92 avatar Jun 30 '22 13:06 felixdittrich92

@charlesmindee, what kind of data do you use to train your text recogntions models ? Do you use custom data ? and do you use special data for french documents ?

nikokks avatar Jul 30 '22 15:07 nikokks

@nikokks for text recognition, we use cropped words from various types of documents, which sum up to about 11M images. The bias is indeed around the choice of characters (European mostly) and the language (some sequences of characters are more frequent than others).

However, a while back, we started a fully synthetic approach (cf. CharacterGenerator and WordGenerator). So far, the results are not on par, but still very decent for a fully synthetic approach :)

frgfm avatar Aug 01 '22 08:08 frgfm

Training started on Linknet_Resnet50 (Tensorflow), we'll post the results soon :wink:

odulcy-mindee avatar May 26 '23 15:05 odulcy-mindee

Detection models in Tensorflow are done! Now, we start recognition models in Tensorflow. First one is master!

odulcy-mindee avatar Jun 26 '23 14:06 odulcy-mindee

Closing because we track it in #1364

felixdittrich92 avatar Nov 08 '23 17:11 felixdittrich92