centermask2 icon indicating copy to clipboard operation
centermask2 copied to clipboard

Total loss doesn't goes down less 1.2 for small objects

Open dmitryshendryk opened this issue 4 years ago • 0 comments

I'me training for small object the model. Using now the ResNet backbone. And the loss doesn't go down less 1.2. I also tried the vovnet backbone, the same story.

Logs from training loss_fcos_loc: 0.175 loss_fcos_ctr: 0.633 time: 0.6485 data_time: 0.0014 lr: 0.000050 max_mem: 4282M [05/25 12:13:24 d2.utils.events]: eta: 4:25:05 iter: 5019 total_loss: 1.281 loss_mask: 0.393 loss_maskiou: 0.005 loss_fcos_cls: 0.105 loss_fcos_loc: 0.168 loss_fcos_ctr: 0.621 time: 0.6485 data_time: 0.0014 lr: 0.000050 max_mem: 4282M [05/25 12:13:36 d2.utils.events]: eta: 4:24:51 iter: 5039 total_loss: 1.318 loss_mask: 0.338 loss_maskiou: 0.005 loss_fcos_cls: 0.117 loss_fcos_loc: 0.190 loss_fcos_ctr: 0.617 time: 0.6485 data_time: 0.0014 lr: 0.000050 max_mem: 4282M [05/25 12:13:49 d2.utils.events]: eta: 4:24:26 iter: 5059 total_loss: 1.216 loss_mask: 0.375 loss_maskiou: 0.005 loss_fcos_cls: 0.097 loss_fcos_loc: 0.148 loss_fcos_ctr: 0.627 time: 0.6485 data_time: 0.0014 lr: 0.000050 max_mem: 4282M

Do you have any idea why it's happening ?

dmitryshendryk avatar May 25 '20 09:05 dmitryshendryk