about policy loss

[Chenhait]

hi, thank you for this wonderful job.

I am a new bird in RL, and I try to use your code in my env,

however, this policy loss seems a little strange.

I wonder it is right or I make some mistake?

Thank you again and wish you everything good