CornerNet icon indicating copy to clipboard operation
CornerNet copied to clipboard

The loss doesn't change

Open ckqsars opened this issue 6 years ago • 4 comments

@makalo Because I only could train on the 1080ti GPU, I set the batch size is 2. However the loss is around 18 the focal_loss is around 36. I want to know the loss when you trian the model

ckqsars avatar Dec 18 '18 02:12 ckqsars

I use eight TITAN-v to train. Loss can be reduced to 0.5. I provide single card and multi-card training in my code, but I haven't trained with single card, maybe it's a matter of training time. You can try multi-card training, because I have verified it on multi-card training.

makalo avatar Dec 18 '18 02:12 makalo

@makalo I have used two TITAN to train. The loss was reduced to 3 when the step is around 170 thousand. How many steps you have trained when the loss was reduced to 0.5.

I also want to know the batch_size you set when you train.

Thank you very much

ckqsars avatar Dec 24 '18 08:12 ckqsars

@ckqsars have you solve this problem?I get loss 3,too. And the result is very bad, I don't know how to reduce loss to 0.5

MaskVulcan avatar Jun 05 '19 17:06 MaskVulcan

@makalo I have tryed the train.py and I see the debug image that saved, There are no predicted box but only Ground Truth, this means that it don't work at all. How can you train so well?

MaskVulcan avatar Jun 06 '19 04:06 MaskVulcan