tdmpc2
tdmpc2 copied to clipboard
[Question] Solving POMDP in TDMPC2
First of all, thank you for open-sourcing this algorithm. I am trying to train a quadruped robot locomotion policy with multimodal input, including egocentric depth vision, on complex terrain. However, I have noticed that TDMPC does not apply to POMDP. Setting observation history as input is possible, but the planning step might be able to benefit from past latent dynamics. Have you conducted any experiments on such ideas?