E2E-MLT icon indicating copy to clipboard operation
E2E-MLT copied to clipboard

All loss values become nan

Open AniketGurav opened this issue 2 years ago • 2 comments

Respected Sir,

Thanks for your work. I am working on images that have only horizontal text.

During training following loss values eventually become nan after few steps. Those loss are bbox_loss,seg_loss,angle_loss and loss These values are present in train.py between lines 487 to 497

Can you please let me know what can be the issue and is there any change required in code when only horizontal text is present.

--- Aniket

AniketGurav avatar Aug 04 '22 10:08 AniketGurav

Hi, The horizontal and vertical text are supported.

  • with no additional information, I think the issue will be in data feeding. (nan values can be result of len(gt) > len(features) - for ctc loss the gt must be able to fit length of the feature vector).

you can run training with a debug option to see, what are you feeding in ...

the data format description: https://github.com/MichalBusta/E2E-MLT/tree/master/sample_train_data/MLT

  • note, that for ICDAR format, order of the coordinates matter.

Hope it helps, Michal

MichalBusta avatar Aug 07 '22 08:08 MichalBusta

Thank you

AniketGurav avatar Sep 07 '22 10:09 AniketGurav