DDPG-Keras-Torcs
DDPG-Keras-Torcs copied to clipboard
yanpanlau
Torcs is continuously relaunching!
Hi,
I am trying to run your ddpg code. I setup Torcs and all required packages. When I run torcs in my terminal, it runs well and I can play without any problem. But, whenever I try to execute the ddpg code, the torcs environment continuously relaunches. I am not been able to get the issue.
Here is the snapshot.
I also studied gym_torcs.py where reset() functions are written, autostart.sh, and snakeoil3_gym.py. But, couldn't resolve it! Can you please tell me if I'm missing something!
Actually I solved the problem. We need to also install vtorcs-RL-color. The relaunching loop issue is solved for me!
Yes,..I solved it! Sorry...forgot to update the issue.. Anyway, thanks a lot for your response!
But I am trying to train from scratch. I get a frozen screen and the message "Timeout for client answer." Were you able to train from scratch? Also, the weights file provided in GitHub (that came with this code) is not driving well. Did you have similar issues?
Yes, I am able to train it from scratch. I didn't use the weight files provided. So, cann't say how well it works.
Regarding the timeout problem, I remember I edited the sever source files in the "src" folder of vtorcs-RL-color. You can try increasing the timeout value there and see whether it works fine or not. I remember I set it to 60sec. After editing the src files, you need to reinstall vtorcs-RL-color to see the change.
I suppose you are referring to line 67 of this file: vtorcs-RL-color/src/drivers/scr_server/scr_server.cpp
which currently is set to: #define UDP_DEFAULT_TIMEOUT 100000
Should I increase this number?
Yes, you can try increasing that value. I guess it is 1ms. Also, make sure the change gets affected! If there is no change after modification, the timeout print statement is somewhere down the file. You can try to check the code segment out.
One final question. To train from scratch, how many episodes did you need for the car to drive properly? It is currently set to the following values:
episode_count = 2000 max_steps = 100000
It takes large number of episodes....I ran it for 200 and stopped. However, you can get some improvement by tuning certain parameters of the model.
I met the relaunching problem as well. I found the reason maybe the client port 3001, I changed to the origin 3101 and it worked. May it help somebody.
I do have the same problem, I have tried both solutions updated here. But no luck. Could you guys please help me fix .?
This solved the problem for me
- Make sure you have xautomation installed (i missed a dependancy lol)
- Increase the variable
n_failin snakeoil3_gym.py from 5 to 15 or something
Hi @kaushikb258, @sahisnu . I need to increase UDP_DEFAULT_TIMEOUT in scr_server.cpp Can you please give me a hint of how to get the change affected? Thank you a lot
Somewhere near line 67 of vtorcs-RL-color/src/drivers/scr_server/scr_server.cpp you can set: #define UDP_DEFAULT_TIMEOUT 100000000 (this number is time in microseconds, set to a large value)
After that, the following 3 commands to re-compile vtorcs-RL-color: make make install make datainstall
Somewhere near line 67 of vtorcs-RL-color/src/drivers/scr_server/scr_server.cpp you can set: #define UDP_DEFAULT_TIMEOUT 100000000 (this number is time in microseconds, set to a large value)
After that, the following 3 commands to re-compile vtorcs-RL-color: make make install make datainstall
Hi, I’m a novice, I’m learning DDPG recently, I think it’s very cool. However, I have encountered some problems, such as how to set up multiple lanes in torcs, and how to add other vehicles on the lanes, can you please provide some help, thank you, really, I need your help.
