rl-baselines3-zoo

rl-baselines3-zoo copied to clipboard

[Question] Number of parallel environments with hyperparameters optimization

1

### ❓ Question Why is the number of parallel environments (n_envs) set to one when using the optimize-hyperparameters? https://github.com/DLR-RM/rl-baselines3-zoo/blob/e06914e9835b8f3233b18d59943b1464b89ddb90/rl_zoo3/exp_manager.py#L198 Thanks! ### Checklist - [X] I have checked that there is...

suargi

Improve docs adding "--gym-packages" argument

1

## Description improve doc adding "--gym-packages" argument source: https://github.com/DLR-RM/rl-baselines3-zoo/blob/e06914e9835b8f3233b18d59943b1464b89ddb90/rl_zoo3/train.py#L107-L112 ## Motivation and Context - [ ] I have raised an issue to propose this change ([required](https://github.com/DLR-RM/stable-baselines3/blob/master/CONTRIBUTING.md) for new features and...

turbotimon

[Bug]: Optimization log and optimal policy not in `--optimization-log-path` but in `--log-folder`

1

### 🐛 Bug The [help](https://github.com/DLR-RM/rl-baselines3-zoo/blob/e06914e9835b8f3233b18d59943b1464b89ddb90/rl_zoo3/train.py#L44) for `--optimization-log-path` claims: _"Path to save the **evaluation log** and **optimal policy** for each hyperparameter tried during optimization. "_ However, when i run optimization with...

turbotimon

[Bug]: Custom environment not found in gym registry, you maybe meant... error message

1

### 🐛 Bug I am encountering an issue when trying to train my donkeycar simulator agent using the train.py script from rl-baselines3-zoo. While I can successfully import and call the...

jiceline03

[Question] exp_manager reward and GAE discount factors

1

### ❓ Question Hi, I noticed that the algorithm discount factor and reward discount factor are set to be the same in lines 365-367 in rl_zoo3/exp_manager.py `# Use the same...

edmund735

### ❓ Question I trained my custom env with tqc algorithm. However, the trained agent keeps reset every 1000 episodes even though I did not set number of episode for...

SKYLEO98

Added CrossQ

2

## Description Added hyperparameters for SB3 CrossQ. ## Motivation and Context - [ ] I have raised an issue to propose this change ([required](https://github.com/DLR-RM/stable-baselines3/blob/master/CONTRIBUTING.md) for new features and bug fixes)...

danielpalen

Replace deprecated use of 'Repository' when pushing to hub with `HfApi`

3

# Remove deprecated use of 'Repository' when pushing to huggingface hub ## Description As mentioned above, use of the `Repository` class is deprecated: . ## Motivation and Context - [x]...

cochaviz

### 🚀 Feature I got various errors uploading my models to huggingface_hub (didn't include this as a bug report as even the proposed commit that should have fixed my issue...

cochaviz

[Question] Results vastly different for an agent created with Stable Baselines3 using hyperparameters optimized in RL Baselines3 Zoo.

1

### ❓ Question Hello, I first optimize A2C on 1mln steps using RL Baselines3 Zoo: Firstly i have changed `a2c.yml` in RL Baselines3 Zoo to work with RAM version of...

mzelazko