Multi-Agent-Transformer icon indicating copy to clipboard operation
Multi-Agent-Transformer copied to clipboard

Questions about MAMujoco

Open kaiyama12345679 opened this issue 1 year ago • 4 comments

Hi, I'm very instersted in your work, and I want to test your MAT for MAMujoco. So, Do you have any experimental results or config of the MAMujoco Envirionment other than "HalfCheetah"?

kaiyama12345679 avatar Dec 26 '23 03:12 kaiyama12345679

hiya, thank you for your interesting, but we don't have results on other ma-mujoco map w.r.t MAT, since we use ma-mujoco mainly to simulate robot failure scenarios (for Table 3)....thus only choose the simplest case~

morning9393 avatar Dec 28 '23 07:12 morning9393

@morning9393 , thanks for your reply.

Can I ask one more question? I want to know whether get_obs_agent() in your MAMujoco is globally observable or partially observable, because there is differences between the obsk.py of original MAMujoco and that of yours.

kaiyama12345679 avatar Dec 28 '23 13:12 kaiyama12345679

@kaiyama12345679 hiya, Questions are always welcome~~ :))

in the file "train_mujoco.sh", you may find that we set agent_obsk=0, which means each agent obs returned by get_obs_agent() contained only the information corresponding to its own node, without neighbors, which is different from the original MA-Mujoco settings (usually agent_obsk=1 or agent_obsk=2, means it will contain information from the current node and all the nearest neighbor nodes with distances 1 or 2).

you can also change the agent_obsk if you would like to include more information into the agent obs~

hoping it might help you~

morning9393 avatar Dec 28 '23 17:12 morning9393

@morning9393, I'm sorry I didn't make the question clear enough. I would like to know why there is a difference between "build_obs()" in obsk.py and that of original MAMujoco, which seems to be the same as the commented out part in yours.

https://github.com/PKU-MARL/Multi-Agent-Transformer/blob/be3ff49c8264d454c1fe2c41582aa2bfc98498c8/mat/envs/ma_mujoco/multiagent_mujoco/obsk.py#L74-L242

kaiyama12345679 avatar Dec 30 '23 07:12 kaiyama12345679