rllte

rllte copied to clipboard

I made a breaking change to the Craftax folder structure in `v1.2.0`, so the imports now require a `craftax.` prefix.

MichaelTMatthews

[Bug]: Potential bug in TorchRunningMeanStd

2

During my debugging I came across the computation of the updated value for the running mean: https://github.com/RLE-Foundation/rllte/blob/5b984b0cb16e773260a77f2407d8a36273b8cef9/rllte/common/utils.py#L80 It doesn't really influence me as I'm not using it right now but...

dominikonysz

[Question] AttributeError: 'Categorical' object has no attribute 'dist'

1

### ❓ Question When I try the code in intrinsic_reward_shaping.ipynb, I get an error. The detailed error are as the following: Traceback (most recent call last): File "/home/x1/anaconda3/envs/x2/lib/python3.8/code.py", line 90,...

yq60523

## Description I have implemented the E3B intrinsic reward proposed [here](https://arxiv.org/abs/2210.05805). I have added the SuperMarioBros environment, which I have used to validate the E3B implementation. I have also fixed...

roger-creus

[Question] Why is the default discount factor 0.999 for PPO and 0.99 for DQN?

1

### ❓ Question I would think 0.99 is the most widely used default value, so I suggest using that for PPO as well. ### Checklist - [X] I have checked...

roger-creus

## Description I have added a new agent -- PPO + LSTM, together with the new EpisodicRolloutBuffer, which is similar to VanillaRolloutBuffer but samples entire trajectories instead of random transitions...

roger-creus

## Description ## Motivation and Context - [x] I have raised an issue to propose this change ([required](https://github.com/RLE-Foundation/rllte/blob/master/CONTRIBUTING.md) for new features and bug fixes) ## Types of changes - [...

Heodel

[Question] Chat Groups for Communication

2

### ❓ Question Dear all, To facilitate technical exchange and Q&A, we prepare the following chat groups: - **QQ Group: 883949936** - **Slack Group: [rlltedevelo-msx2832.slack.com](https://rlltedevelo-msx2832.slack.com/join/shared_invite/zt-27d3ws5b8-facjIISWZwz1QL9DFXRMtg#/shared-invite/email)** Feel free to join them!😁😁😁...

myismyname

[Bug]: RE3 crashes when self.k > self.idx

1

### 🐛 Bug In the example in the documentation [here](https://docs.rllte.dev/tutorials/mt/irs/) RE3 crashes in `re3.py` - line 174 when `self.k > self.idx`. This can happen when the storage size has been...

roger-creus

[Progress Report] Construction of RLLTE Data Hub

3

Due to the high computing power required for training, we will gradually upload data to the data hub and report the progress in this issue. We will also change the...

myismyname