ptan

ptan copied to clipboard

- [ ] update requirements - [ ] migrate tests for pytest - [ ] migrate to gymnasium wrappers

Shmuma

RaeChim

Experience Source asserts when env == gym.Env However, newer gymnasium Env is (same but) diferent from gym.Env. the solution is just to delete this assertion and include gym.Env typing ```...

leinaxd

If you go to the github page of [Atari-py](https://github.com/openai/atari-py) then you will see the following > **Status**: Deprecated (don't expect bug fixes or other updates) > > Notice: atari-py is...

rcshubhadeep

Hi, I like your library. Great job! However, I deep dived your code and it's hard to make adaptions for multi agent scenarios. Did you ever think about it?

nelyodev

I noticed that the requirements in setup.py show that the version of PyTorch must be 1.7.0, I'm wondering whether 1.7.1v will be OK?

yunqi10qiu

Added the option to specify on how many recent rewards the RewardTracker should average on.

Fable67

In samples/rainbow/05_dqn_prio_replay.py, weights are propagated to batch_weights_v and multiplied by (state_action_values - expected_state_action_values) ** 2 to calculate losses_v. (losses_v + 1e-5) is then used to calculate probabilites. However, according to...

dimaga

Slower speed than book indicates

3

I'm using PyTorch 1.0.1 with Cuda 10.1 and have 8 cores. I have the same 1080 TI as you have. However, I get only half the speed when running your...

NikEyX

Hi, how do I get numpy array froma LazyFrame to simply play the Trained nets ?

4

I have into Chapter 7 of your book. Its really impressive, however many details are buried within this PTAN package. I believe I have trained a number of nets against...

JulesVerny