Yueyi Zhang

icon company Nanjing University of Science and Technology icon location GuangZhou

Results 2 comments of Yueyi Zhang

Spelling mistake

Thanks for your code. I have a little suggestion : move "agent.update(one_ep_transition)" out of the loop, then it will be at least 60 times faster than before. In practice, I...

Why the code for Learner is so complicated?

Because we need to find the second-order derivative. Use nn.sequential can't achieve fast_weight and slow_weight, you can't get second-order derivative due to computation graph