A confusion about helloworld_DQN_single_file.py

Open guest-oo opened this issue 1 year ago • 2 comments

Why is warm up for ReplayBuffer used in helloworld_DQN_single_file.py but not in elegantrl?

Oct 06 '24 05:10 guest-oo

Warming up for replaybuffer is not necessary for off-policy DRL algorithm. I plan to cancel warning up.

Oct 10 '24 05:10 Yonv1943

Warming up for replaybuffer is not necessary for off-policy DRL algorithm. I plan to cancel warning up. Thanks for your answer, I also found that Warming up for replaybuffe is not a necessary step for DQN, and there are many example codes that do not use this.

Nov 29 '24 16:11 guest-oo