Zhaohhya comments

Repositories
Issues
Comments

Results 3 comments of


                                            Zhaohhya

make_vec(...) will raise error "AttributeError: can't set attribute", while vector.make(..) doesn't for customized env

I've found similar problems. I'm following the warning `WARN: gymnasium.vector.make(...) is deprecated and will be replaced by gymnasium.make_vec(...) in v1.0` Using the following code `envs = gym.make_vec("InvertedPendulum-v4", num_envs = 3,...

Errors reported in this section of USING PRETRAINED MODELS

Here's how I modified it. `rb = ReplayBuffer(storage=storage, transform=r3m)`modified to `rb = ReplayBuffer(storage=storage)` Add ``` batch = rb.sample(32) batch = batch.to(device) transformed_batch = r3m(batch) ```

In the Doc “RECURRENT DQN: TRAINING RECURRENT POLICIES”

Using the 'is_init' key, I found that env is always reset on the second step of a batch