garage icon indicating copy to clipboard operation
garage copied to clipboard

Published 20 hours ago • verified publisher icon rlworkgroup

implementation detail question about MAMLPPO

Open seolhokim opened this issue 2 years ago • 0 comments

Hi, Thank you for providing the quality code. I have a implementation detail question.

  1. Why don't you just call optimizer.step() after meta_objective.backward()?

https://github.com/rlworkgroup/garage/blob/f056fb8f6226c83d340c869e0d5312d61acf07f0/src/garage/torch/algos/maml.py#L124-L127

seolhokim avatar Aug 02 '22 07:08 seolhokim