tdmpc2 icon indicating copy to clipboard operation
tdmpc2 copied to clipboard

[Question] Solving POMDP in TDMPC2

Open gmmyung opened this issue 6 months ago • 1 comments

First of all, thank you for open-sourcing this algorithm. I am trying to train a quadruped robot locomotion policy with multimodal input, including egocentric depth vision, on complex terrain. However, I have noticed that TDMPC does not apply to POMDP. Setting observation history as input is possible, but the planning step might be able to benefit from past latent dynamics. Have you conducted any experiments on such ideas?

gmmyung avatar Aug 06 '24 08:08 gmmyung