Minari
Minari copied to clipboard
[Question] An easy recipe for DataCollector on Vectorized Envs?
Question
Hello, the majority of data collections from simulated environments comes from parallel data collectors such as VecEnvs and methods that return either a step data with a batch dimension or even at the end of the collector a list like collection of episode data.
By now the simpler scenario is to sample using VecEnv so is there any simple recipe for adapting the current DataCollector for VecEnv format?
Hello @jamartinh, thanks for the question We indeed plan to add support for VecEnv in DataCollector (any help welcome :D)
If you need to use DataCollector now with a VectorEnv, you will need some customize code adjustment. Probably the esier way is to deal with VectorEnv as a normal env