qwangku

I have the same question. And also about the outer loop "for type in range(2):". Do you know that was outer loop is used for? I guess "type" here means...

@MarSaKi Thanks for sharing this great material. Another question about the losses, I am reading the cal_loss() implementation in policy_gradient.py and PPO.py. I am a beginner to the field of...