How to set the parameter to customize the number of hidden layers and their hidden sizes

[astonisingHSR]

❓ Question

Setting the config parameter seems to only make all the hidden layers the same size. How can I set the parameter to customize the number of hidden layers and their respective sizes? For examples, if i want to set up a policy network with three hidden layers, each of size 128, 64, 32. How do I set or modify the config parameter. I would appreciate it if you could give me a detailed reply.

Checklist

• [X] I have checked that there is no similar issues in the repo
• [X] I have read the documentation

[huangshiyu13]

You can pass your predefined neural network to the OpenRL:

Code Examples1: https://github.com/OpenRL-Lab/openrl/blob/8797b0999b0bacdac0658eda54c137f0c06e4544/examples/sb3/train_ppo.py#L37 Code Example2: https://github.com/OpenRL-Lab/openrl/blob/8797b0999b0bacdac0658eda54c137f0c06e4544/examples/nlp/train_ppo.py#L25 Document: https://openrl-docs.readthedocs.io/en/latest/quick_start/train_nlp.html

[astonisingHSR]

Thank you for your careful response!