dreamerv2 icon indicating copy to clipboard operation
dreamerv2 copied to clipboard

Published 20 hours ago • verified publisher icon danijar

Performance difference between TruncNormal and TanhNormal

Open IcarusWizard opened this issue 1 year ago • 0 comments

Hey @danijar.

I just noticed that the code is using TruncNormal as the actor distribution instead of TanhNormal as in v1. I wonder did you make some ablations on these two choices and see TruncNormal provide better results? Or the change is only because the entropy of TruncNormal is easier to compute than TanhNormal for the entropy regularizer?

IcarusWizard avatar Jan 18 '23 16:01 IcarusWizard