garage
garage copied to clipboard
implementation detail question about MAMLPPO
Hi, Thank you for providing the quality code. I have a implementation detail question.
- Why don't you just call optimizer.step() after meta_objective.backward()?
https://github.com/rlworkgroup/garage/blob/f056fb8f6226c83d340c869e0d5312d61acf07f0/src/garage/torch/algos/maml.py#L124-L127