Difference between new DreamerV3 and 2023 DreamerV3

[jing-yu-lim]

Hi, I have recently discovered that the current version of DreamerV3 is new and updated since the commit 'Update agent and infrastructure' (https://github.com/danijar/dreamerv3/commit/2411f7d136832378c0291c587cdbf2fca6506873). This resulted in a drastic change in performance for atari100k.

May I kindly check what are agent and infrastructure updates?

Cheers

[rsun0]

Here is a thread summarizing the major changes to DreamerV3: https://x.com/danijarh/status/1782820513401958441

However, I am not sure if there is another source that describes more details or if @danijar can elaborate on the changes.

You can also try to compare the 2 versions of the paper on arXiv (v1 and v2, left side of the page): https://arxiv.org/abs/2301.04104

[danijar]

Which version of ale-py are you using? See: https://github.com/Farama-Foundation/Arcade-Learning-Environment/issues/594