Katze2664
Katze2664
In 01_intro.ipynb on Colab, when I run the first cell `#hide ! [ -e /content ] && pip install -Uqq fastbook import fastbook fastbook.setup_book()` it requests access to my Google...
Patch 6
wrapper_args is a list of lists, not list of dicts
When self.size == self._initial_size, ReplayMemory.initialized should be True
Simpler prediction using np.matmul (Apologies if this code doesn't work in a way that I've overlooked.)
Typo in variable name self._list_reference
self.disc_episode_returns should be calculated before incrementing self.episode_lengths
self.episode_lengths is initialized to an array of zeros by [MORecordEpisodeStatistics](https://github.com/Farama-Foundation/MO-Gymnasium/blob/main/mo_gymnasium/utils.py).reset(self, **kwargs) (line 234) `obs, info = super().reset(**kwargs)` [RecordEpisodeStatistics](https://github.com/Farama-Foundation/Gymnasium/blob/81b87efb9f011e975f3b646bab6b7871c522e15e/gymnasium/wrappers/record_episode_statistics.py).reset(self, **kwargs) (line 83): `self.episode_lengths = np.zeros(self.num_envs, dtype=np.int32)` MORecordEpisodeStatistics.step increments self.episode_lengths **before** calculating...