robosuite-benchmark icon indicating copy to clipboard operation
robosuite-benchmark copied to clipboard

Doubt Regarding rollout() function

Open vyasakash231 opened this issue 8 months ago • 0 comments

In the rollout() function, at https://github.com/rail-berkeley/rlkit/blob/master/rlkit/samplers/rollout_functions.py A condition is given that if done is True, then terminal will also turn true.

    terminal = False
    if done:
        # terminal=False if TimeLimit caused termination
        if not env_info.pop('TimeLimit.truncated', False):
            terminal = True
    terminals.append(terminal)
    dones.append(done)
    actions.append(a)
    next_observations.append(next_o)
    raw_next_obs.append(next_o)
    agent_infos.append(agent_info)
    env_infos.append(env_info)
    path_length += 1
    if done:
        break

Now, in all of the .json files, it was specified that ignore_done=True, which means done is always false.

  "eval_environment_kwargs": {
    "control_freq": 20,
    "controller": "OSC_POSE",
    "env_name": "Lift",
    "hard_reset": false,
    "horizon": 500,
    "ignore_done": true,
    "reward_scale": 1.0,
    "robots": [
      "Sawyer"
    ]
  },
  "expl_environment_kwargs": {
    "control_freq": 20,
    "controller": "OSC_POSE",
    "env_name": "Lift",
    "hard_reset": false,
    "horizon": 500,
    "ignore_done": true,
    "reward_scale": 1.0,
    "robots": [
      "Sawyer"
    ]

Can anyone please explain this part?

vyasakash231 avatar May 26 '24 17:05 vyasakash231