Getting nan loss for a custom dataset

[SumayyaInayat]

Hi Zichen Wang, I hope you are well. You have done a wonderful job.The idea is great and thanks alot for sharing the code.

I have two custom datasets and I trained the model for one, giving me good mAP but when train on another, it is giving nan losses after 50 iterations.

Both the datasets are relatively similar except for the object sizes, in the first one, object size are small as compared to the standard voc dataset objects. I got results for this dataset.

While in another, object sizes are of medium size. But I am getting nan loss. The bounding boxes are correct.

If you can help or guide me in this, it would be great.

Thanks & Regards! Sumayya