Antonin RAFFIN

hello, this looks good indeed =) See https://stable-baselines3.readthedocs.io/en/master/guide/custom_policy.html

Hello, > Why are there three flatten extractors instead of just one? You should find your answer in https://github.com/DLR-RM/stable-baselines3/pull/1148 and https://github.com/DLR-RM/stable-baselines3/issues/1066 In short, sometimes you want to share the features...

> Thanks for the suggestion! I’d be happy to contribute to the documentation. Could you please point me to the relevant files or guidelines so I can get started? guidelines...

Hello, > but only 64 G available in my k8s container. I ran a training script, which is estimated to require 30 G memory. if there is 64GB available and...

> It is ok to decrease the buffer_size but not being notified of potential "Out of Memory" is bad. Do you have a proposed fix?

Probably a duplicate of https://github.com/DLR-RM/rl-baselines3-zoo/issues/314 https://github.com/DLR-RM/rl-baselines3-zoo/issues/204 and others (see link in the other issues)

@copilot the env checker file is too long, put the vec env checker code in another file, same for the tests. Update also the documentation to add an example on...

@copilot check that the proposes changes do not raise any new issues from the linter/type checker (use `pip install -e .[tests,docs]` and then `make commit-checks`), fix the build issue is...

Could you give me access to your repo or change the branch to something different than master? I cannot push edits :/

Hello, i think that was to mimic DQN and have some kind of delayed update (but this is not used by default). Gradient steps is not always zero (it depends...