RL_arm_under_sparse_reward icon indicating copy to clipboard operation
RL_arm_under_sparse_reward copied to clipboard

Published 20 hours ago • verified publisher icon PiggyCh

about action space

Open guanxiaoyuan opened this issue 1 year ago • 5 comments

your comments : action 和 obs space 的 low and high 可能需要再次考虑 my concern：action dim = 4 ？ why Not = 6 (up/down/left/right/forward/backward)

guanxiaoyuan avatar Jan 22 '24 11:01 guanxiaoyuan

because 3 for 3D world displacement, 1 for hand open and grasp.

PiggyCh avatar Jan 22 '24 12:01 PiggyCh

Don't Care too much, such a lowlevel I did 3 years ago when i was a student. always make junk code.

PiggyCh avatar Jan 22 '24 12:01 PiggyCh

actually，you，my friend，are the true hero !

guanxiaoyuan avatar Jan 23 '24 01:01 guanxiaoyuan

hello, man, here is new question about motorcommand control, in bmirobot.py why position control at line 119 & 153 in range(3, 10) & range(3, 12) ? and the targetposition in setJointMotorControl2 is set to be jointposition[i-3]?

guanxiaoyuan avatar Jul 15 '24 03:07 guanxiaoyuan

ok, I understand, IK computation ignores 3 right-hand fixed Joint, but the Joint Index exists.

hello, man, here is new question about motorcommand control, in bmirobot.py why position control at line 119 & 153 in range(3, 10) & range(3, 12) ? and the targetposition in setJointMotorControl2 is set to be jointposition[i-3]?

guanxiaoyuan avatar Jul 15 '24 05:07 guanxiaoyuan