RLzoo icon indicating copy to clipboard operation
RLzoo copied to clipboard

Could PPO solve DM control tasks?

Open zhihaocheng opened this issue 4 years ago • 0 comments

I install RLzoo and use its PPO to train an agent for DM Control Suite. I tested environments CheetahRun-v0 and CartpoleSwingup-v0, but the current PPO could solve neither of both. Could you please help me? I attach the testing reward for CartpoleSwingup-v0 below.

Testing... | Algorithm: PPO_CLIP | Environment: CartpoleSwingup-v0 Episode: 0/100 | Episode Reward: 28.4757 | Running Time: 0.5145 Episode: 1/100 | Episode Reward: 28.9385 | Running Time: 0.9912 Episode: 2/100 | Episode Reward: 28.6354 | Running Time: 1.4690 Episode: 3/100 | Episode Reward: 29.3395 | Running Time: 1.9561 Episode: 4/100 | Episode Reward: 28.6659 | Running Time: 2.4513 Episode: 5/100 | Episode Reward: 29.1282 | Running Time: 2.9346 Episode: 6/100 | Episode Reward: 28.1226 | Running Time: 3.4143 Episode: 7/100 | Episode Reward: 28.2178 | Running Time: 3.8957 Episode: 8/100 | Episode Reward: 28.2538 | Running Time: 4.3784 Episode: 9/100 | Episode Reward: 28.1161 | Running Time: 4.8581 Episode: 10/100 | Episode Reward: 28.2593 | Running Time: 5.3397 Episode: 11/100 | Episode Reward: 28.5096 | Running Time: 5.8084 Episode: 12/100 | Episode Reward: 27.9026 | Running Time: 6.2774 Episode: 13/100 | Episode Reward: 28.5970 | Running Time: 6.7430 Episode: 14/100 | Episode Reward: 28.6751 | Running Time: 7.2089 Episode: 15/100 | Episode Reward: 28.5764 | Running Time: 7.6745 Episode: 16/100 | Episode Reward: 28.2926 | Running Time: 8.1450 Episode: 17/100 | Episode Reward: 28.1627 | Running Time: 8.6118 Episode: 18/100 | Episode Reward: 28.3646 | Running Time: 9.1045 Episode: 19/100 | Episode Reward: 29.0091 | Running Time: 9.5852 Episode: 20/100 | Episode Reward: 28.6220 | Running Time: 10.0611 Episode: 21/100 | Episode Reward: 28.0959 | Running Time: 10.5363 Episode: 22/100 | Episode Reward: 28.3945 | Running Time: 11.0277 Episode: 23/100 | Episode Reward: 27.9222 | Running Time: 11.4943 Episode: 24/100 | Episode Reward: 29.1726 | Running Time: 11.9824 Episode: 25/100 | Episode Reward: 27.4740 | Running Time: 12.4491 Episode: 26/100 | Episode Reward: 29.0847 | Running Time: 13.0193 Episode: 27/100 | Episode Reward: 28.7490 | Running Time: 13.5816 Episode: 28/100 | Episode Reward: 29.4471 | Running Time: 14.0713 Episode: 29/100 | Episode Reward: 28.9889 | Running Time: 14.5420 Episode: 30/100 | Episode Reward: 27.9317 | Running Time: 15.0105 Episode: 31/100 | Episode Reward: 28.6057 | Running Time: 15.4807 Episode: 32/100 | Episode Reward: 27.9958 | Running Time: 15.9642 Episode: 33/100 | Episode Reward: 28.7247 | Running Time: 16.4500 Episode: 34/100 | Episode Reward: 28.7462 | Running Time: 16.9543 Episode: 35/100 | Episode Reward: 27.8867 | Running Time: 17.4389 Episode: 36/100 | Episode Reward: 28.2105 | Running Time: 17.9195 Episode: 37/100 | Episode Reward: 28.7734 | Running Time: 18.4043 Episode: 38/100 | Episode Reward: 28.7227 | Running Time: 18.8784 Episode: 39/100 | Episode Reward: 28.0787 | Running Time: 19.4129 Episode: 40/100 | Episode Reward: 28.7410 | Running Time: 19.9047 Episode: 41/100 | Episode Reward: 28.2244 | Running Time: 20.3926 Episode: 42/100 | Episode Reward: 28.6137 | Running Time: 20.8720 Episode: 43/100 | Episode Reward: 28.1213 | Running Time: 21.3447 Episode: 44/100 | Episode Reward: 28.7770 | Running Time: 21.8240 Episode: 45/100 | Episode Reward: 28.4468 | Running Time: 22.3140 Episode: 46/100 | Episode Reward: 28.3316 | Running Time: 22.7774 Episode: 47/100 | Episode Reward: 28.9745 | Running Time: 23.2579 Episode: 48/100 | Episode Reward: 28.5198 | Running Time: 23.7473 Episode: 49/100 | Episode Reward: 28.2299 | Running Time: 24.2266 Episode: 50/100 | Episode Reward: 27.5498 | Running Time: 24.7056 Episode: 51/100 | Episode Reward: 28.1589 | Running Time: 25.1900 Episode: 52/100 | Episode Reward: 28.2864 | Running Time: 25.6784 Episode: 53/100 | Episode Reward: 28.6884 | Running Time: 26.1567 Episode: 54/100 | Episode Reward: 28.1469 | Running Time: 26.6400 Episode: 55/100 | Episode Reward: 28.5643 | Running Time: 27.1302 Episode: 56/100 | Episode Reward: 28.3990 | Running Time: 27.6151 Episode: 57/100 | Episode Reward: 28.4950 | Running Time: 28.0974 Episode: 58/100 | Episode Reward: 27.8701 | Running Time: 28.5832 Episode: 59/100 | Episode Reward: 28.7812 | Running Time: 29.0694 Episode: 60/100 | Episode Reward: 27.9976 | Running Time: 29.5470 Episode: 61/100 | Episode Reward: 28.6969 | Running Time: 30.0193 Episode: 62/100 | Episode Reward: 28.6212 | Running Time: 30.4909 Episode: 63/100 | Episode Reward: 27.4787 | Running Time: 30.9708 Episode: 64/100 | Episode Reward: 28.4545 | Running Time: 31.4938 Episode: 65/100 | Episode Reward: 28.5045 | Running Time: 31.9696 Episode: 66/100 | Episode Reward: 27.7482 | Running Time: 32.4473 Episode: 67/100 | Episode Reward: 28.2154 | Running Time: 32.9266 Episode: 68/100 | Episode Reward: 28.5635 | Running Time: 33.3989 Episode: 69/100 | Episode Reward: 28.1430 | Running Time: 33.8813 Episode: 70/100 | Episode Reward: 28.6439 | Running Time: 34.3629 Episode: 71/100 | Episode Reward: 28.0486 | Running Time: 34.8364 Episode: 72/100 | Episode Reward: 28.7735 | Running Time: 35.3201 Episode: 73/100 | Episode Reward: 28.5547 | Running Time: 35.8198 Episode: 74/100 | Episode Reward: 28.8559 | Running Time: 36.3093 Episode: 75/100 | Episode Reward: 28.3621 | Running Time: 36.7830 Episode: 76/100 | Episode Reward: 28.5224 | Running Time: 37.2498 Episode: 77/100 | Episode Reward: 27.8541 | Running Time: 37.7178 Episode: 78/100 | Episode Reward: 28.5152 | Running Time: 38.1858 Episode: 79/100 | Episode Reward: 28.2094 | Running Time: 38.6564 Episode: 80/100 | Episode Reward: 27.7631 | Running Time: 39.1511 Episode: 81/100 | Episode Reward: 28.6392 | Running Time: 39.6275 Episode: 82/100 | Episode Reward: 29.1371 | Running Time: 40.1082 Episode: 83/100 | Episode Reward: 28.3666 | Running Time: 40.6566 Episode: 84/100 | Episode Reward: 28.5571 | Running Time: 41.1946 Episode: 85/100 | Episode Reward: 27.9868 | Running Time: 41.7414 Episode: 86/100 | Episode Reward: 28.3500 | Running Time: 42.3022 Episode: 87/100 | Episode Reward: 28.3478 | Running Time: 42.8577 Episode: 88/100 | Episode Reward: 28.2653 | Running Time: 43.4031 Episode: 89/100 | Episode Reward: 27.4543 | Running Time: 43.9250 Episode: 90/100 | Episode Reward: 28.3082 | Running Time: 44.4695 Episode: 91/100 | Episode Reward: 28.7126 | Running Time: 44.9914 Episode: 92/100 | Episode Reward: 28.8012 | Running Time: 45.5375 Episode: 93/100 | Episode Reward: 28.3971 | Running Time: 46.0787 Episode: 94/100 | Episode Reward: 28.2597 | Running Time: 46.6196 Episode: 95/100 | Episode Reward: 28.6428 | Running Time: 47.1560 Episode: 96/100 | Episode Reward: 28.4852 | Running Time: 47.6989 Episode: 97/100 | Episode Reward: 29.4192 | Running Time: 48.2465 Episode: 98/100 | Episode Reward: 29.0577 | Running Time: 48.7841 Episode: 99/100 | Episode Reward: 28.3379 | Running Time: 49.3224

zhihaocheng avatar Jun 29 '21 02:06 zhihaocheng