agenthive icon indicating copy to clipboard operation
agenthive copied to clipboard

Error after using the latest torchrl version

Open ShahRutav opened this issue 2 years ago • 1 comments

Command: HYDRA_FULL_ERROR=1 sim_backend=MUJOCO MUJOCO_GL=egl python train.py task=kitchen_knob1_off-v3 visual_transform= env_per_collector=1 lr=1e-3 hydra/launcher=local hydra/output=local

Traceback (most recent call last):
  File "train.py", line 20, in <module>
    main()
  File "/home/rutavms/miniconda3/envs/rlhive/lib/python3.8/site-packages/hydra/main.py", line 90, in decorated_main
    _run_hydra(
  File "/home/rutavms/miniconda3/envs/rlhive/lib/python3.8/site-packages/hydra/_internal/utils.py", line 394, in _run_hydra
    _run_app(
  File "/home/rutavms/miniconda3/envs/rlhive/lib/python3.8/site-packages/hydra/_internal/utils.py", line 457, in _run_app
    run_and_report(
  File "/home/rutavms/miniconda3/envs/rlhive/lib/python3.8/site-packages/hydra/_internal/utils.py", line 222, in run_and_report
    raise ex
  File "/home/rutavms/miniconda3/envs/rlhive/lib/python3.8/site-packages/hydra/_internal/utils.py", line 219, in run_and_report
    return func()
  File "/home/rutavms/miniconda3/envs/rlhive/lib/python3.8/site-packages/hydra/_internal/utils.py", line 458, in <lambda>
    lambda: hydra.run(
  File "/home/rutavms/miniconda3/envs/rlhive/lib/python3.8/site-packages/hydra/_internal/hydra.py", line 132, in run
    _ = ret.return_value
  File "/home/rutavms/miniconda3/envs/rlhive/lib/python3.8/site-packages/hydra/core/utils.py", line 260, in return_value
    raise self._return_value
  File "/home/rutavms/miniconda3/envs/rlhive/lib/python3.8/site-packages/hydra/core/utils.py", line 186, in run_job
    ret.return_value = task_function(task_cfg)
  File "train.py", line 12, in main
    train_sac(args)
  File "/home/rutavms/research/robohive/rlhive/examples/sac.py", line 516, in main
    td_record = recorder(None)
  File "/home/rutavms/miniconda3/envs/rlhive/lib/python3.8/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
    return func(*args, **kwargs)
  File "/home/rutavms/miniconda3/envs/rlhive/lib/python3.8/site-packages/torchrl/trainers/trainers.py", line 1185, in __call__
    value = td_record.get(key).float()
  File "/home/rutavms/miniconda3/envs/rlhive/lib/python3.8/site-packages/tensordict/tensordict.py", line 3214, in get
    return self._default_get(key, default)
  File "/home/rutavms/miniconda3/envs/rlhive/lib/python3.8/site-packages/tensordict/tensordict.py", line 1003, in _default_get
    raise KeyError(
KeyError: 'key "solved" not found in TensorDict with keys [\'action\', \'done\', \'loc\', \'next\', \'observation_vector\', \'reward\', \'sample_log_prob\', \'scale\']'

ShahRutav avatar Mar 14 '23 01:03 ShahRutav

you should replace the key the recorder is looking for by ("next", "solved") I believe

vmoens avatar Mar 14 '23 15:03 vmoens