Loss does not converge during training, which results in a poor evaluation results(map:41.92%)

[Sebastian514]

I used the default hyper-parameters and trained the model on a single Nvidia Titan Xp. And the training logs show that the loss
didn't converge. It apparently leaded to a bad performance which evaluated on coco.

What should I do?