pytorch-ddpg-naf icon indicating copy to clipboard operation
pytorch-ddpg-naf copied to clipboard

Published 20 hours ago • verified publisher icon ikostrikov

NAF Implementation not working!

Open Akella17 opened this issue 3 years ago • 2 comments

The NAF algorithm does not work on Pendulum or any of the PyBullet environments. @ikostrikov Do you have any guesses why that might be the case? Which environments did you experiment with this code on? In case you used different hyperparameters than the default values, could you mention the changes that need to be made to get the NAF algorithm working.

Akella17 avatar Mar 20 '21 16:03 Akella17

NAF might be a little bit outdated (I'm not planning to maintain this repository).

Is there a specific reason to use NAF?

I personally find it easier to tune soft actor-critic on new tasks and there is a bunch of well tested SAC implementations available. For example:

https://github.com/denisyarats/pytorch_sac or https://github.com/ikostrikov/jax-rl

ikostrikov avatar Mar 20 '21 17:03 ikostrikov

I am working on an extension to NAF, so was am looking for a stable NAF implementation.

Akella17 avatar Mar 20 '21 20:03 Akella17