Recall2Imagine icon indicating copy to clipboard operation
Recall2Imagine copied to clipboard

The dmc vision (task=dmc_walker_walk) has very bad performance

Open LYK-love opened this issue 1 month ago • 5 comments

Hello, I ran R2I with command:

current_date=$(date "+%Y%m%d-%H%M%S")
python recall2imagine/train.py \
    --configs dmc_vision \
    --ssm_type mimo \
    --wdb_name  dmc_original_${current_date} \
    --logdir ./logs/dmc_original_${current_date}

and got very low scores. According to DreamerV3 paper, it can achieve score > 900. image

However, R2I can only achieve score < 200. image

I think the hyperparameters are the same, in R2I's config.yaml, I saw

run.train_ratio: 512
  run.steps: 1e6
  rssm.deter: 512
  .*\.cnn_depth: 32
  .*\.layers: 2
  .*\.units: 512

, this aligns with DreamerV3: image

Can you explain why this happens? Maybe it's because the ssm backbone is not so good as gru in this task? Or there's sth wrong with my hyperparameters?

LYK-love avatar May 16 '24 05:05 LYK-love