training with pvrcnn losses not decreasing as seen in the tensor-board !!!!

[mdfaheem786]

training with pvrcnn loss not decreasing as seen in the tensor-board (attached)

please kindly guide me, whether its correct or not?

as i trained with SECONDIOU, here i can see correctly that model is able to learn as expected. below is SECONDIOU tensord-board viz