Bogdan Mazoure
Bogdan Mazoure
Upon running the training script for UL+RL [link](https://github.com/astooke/rlpyt/blob/master/rlpyt/ul/experiments/rl_from_ul/scripts/dmcontrol/train/dmc_sac_from_ul_serial.py), I get two kinds of step metrics: CumSteps (eg 23,000) and EnvSteps (184,000 for the corresponding CumSteps). The reward at this snapshot...
Apologies if this has already been answered before, but I am trying to samples batches of the form (s_t,a_t,r_t,s_t+1,s_t+2,..,s_t+K) where K is a parameter. How would one go about doing...
Tweaked it so it supports pretty much any image extension. Also made it to save into distinct subfolders (enumerated by integers)