gym icon indicating copy to clipboard operation
gym copied to clipboard

Published 20 hours ago • verified publisher icon openai

[Question] Markov property for feature-based control tasks

Open MaximilienLC opened this issue 2 years ago • 1 comments

Question

Do you happen to know if state signals in Classic Control, Box2D & MuJoCo tasks all possess the Markov Property?

MaximilienLC avatar Dec 11 '22 18:12 MaximilienLC

I am not certain due to their current implementation but I believe so. I would check the environments you care about.

pseudo-rnd-thoughts avatar Dec 11 '22 22:12 pseudo-rnd-thoughts