Need dataset keys clarification

[karims]

I see that reach datapoint has the following keys - dict_keys(['dx_dt', 'image', 'other', 'x']).

In the implementation of Physics inspired models, only image key has been used.

I want to use this dataset, but not as images. My questions are:

1. Is it possible to use trajectories of all the 17 datasets without images?
2. Do the keys x, dx_dt refer to trajectory points and derivatives?

[botev]

We use images, as our focus in this was only on models that learn from images. Answering your questions:

1. Yes, there is no issue with using them without the images. The images were added so that there is consistent rendering if people use them.
2. For the toy problem datasets x is the concatenation of position and momenta, and dx_dt is their derivative w.r.t time, for the multi-agent datasets I think the state is the population policies, for mujoco rooms the state is the position of the camera and for molecular dynamics the state is the particle positions and momenta as well.