agenthive
agenthive copied to clipboard
Error after using the latest torchrl version
Command: HYDRA_FULL_ERROR=1 sim_backend=MUJOCO MUJOCO_GL=egl python train.py task=kitchen_knob1_off-v3 visual_transform= env_per_collector=1 lr=1e-3 hydra/launcher=local hydra/output=local
Traceback (most recent call last):
File "train.py", line 20, in <module>
main()
File "/home/rutavms/miniconda3/envs/rlhive/lib/python3.8/site-packages/hydra/main.py", line 90, in decorated_main
_run_hydra(
File "/home/rutavms/miniconda3/envs/rlhive/lib/python3.8/site-packages/hydra/_internal/utils.py", line 394, in _run_hydra
_run_app(
File "/home/rutavms/miniconda3/envs/rlhive/lib/python3.8/site-packages/hydra/_internal/utils.py", line 457, in _run_app
run_and_report(
File "/home/rutavms/miniconda3/envs/rlhive/lib/python3.8/site-packages/hydra/_internal/utils.py", line 222, in run_and_report
raise ex
File "/home/rutavms/miniconda3/envs/rlhive/lib/python3.8/site-packages/hydra/_internal/utils.py", line 219, in run_and_report
return func()
File "/home/rutavms/miniconda3/envs/rlhive/lib/python3.8/site-packages/hydra/_internal/utils.py", line 458, in <lambda>
lambda: hydra.run(
File "/home/rutavms/miniconda3/envs/rlhive/lib/python3.8/site-packages/hydra/_internal/hydra.py", line 132, in run
_ = ret.return_value
File "/home/rutavms/miniconda3/envs/rlhive/lib/python3.8/site-packages/hydra/core/utils.py", line 260, in return_value
raise self._return_value
File "/home/rutavms/miniconda3/envs/rlhive/lib/python3.8/site-packages/hydra/core/utils.py", line 186, in run_job
ret.return_value = task_function(task_cfg)
File "train.py", line 12, in main
train_sac(args)
File "/home/rutavms/research/robohive/rlhive/examples/sac.py", line 516, in main
td_record = recorder(None)
File "/home/rutavms/miniconda3/envs/rlhive/lib/python3.8/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
return func(*args, **kwargs)
File "/home/rutavms/miniconda3/envs/rlhive/lib/python3.8/site-packages/torchrl/trainers/trainers.py", line 1185, in __call__
value = td_record.get(key).float()
File "/home/rutavms/miniconda3/envs/rlhive/lib/python3.8/site-packages/tensordict/tensordict.py", line 3214, in get
return self._default_get(key, default)
File "/home/rutavms/miniconda3/envs/rlhive/lib/python3.8/site-packages/tensordict/tensordict.py", line 1003, in _default_get
raise KeyError(
KeyError: 'key "solved" not found in TensorDict with keys [\'action\', \'done\', \'loc\', \'next\', \'observation_vector\', \'reward\', \'sample_log_prob\', \'scale\']'
you should replace the key the recorder is looking for by ("next", "solved") I believe