ddp-gym icon indicating copy to clipboard operation
ddp-gym copied to clipboard

cost too much time

Open dujinyu opened this issue 5 years ago • 1 comments

hello! I met some problems when i ran your code.

first problem: too much time is needed, the code did not converge after running half an hour.

second problem: you said that you use ilqr, but i still find the Second derivative of dynamics. In ilqr_gym.py, self._f_xx, self._f_uu, self._f_ux exist. This is inconsistent with the ilqr method omitting the second derivative of dynamics.

third problem: it seems that the animation of gym does not work. the pole does not move continuously. image

dujinyu avatar Jun 11 '20 03:06 dujinyu

Hi @dujinyu ,

Thank you for your feedback. The slow computation and drawing discontinuity is due to the computational load of autograd. As for the algorithm, it will be renamed to DDP instead of iLQR.

neka-nat avatar Jun 11 '20 04:06 neka-nat