Hiroki Yokoyama

I'm not sure if it's still a problem, but, yes, this part is what I added. I wanted to weight the training samples so that ones with large difference in...

Thank you for the comment. Recently I had updated train_replay.py (with replay buffer) while leaving train.py (without replay buffer) old. Now they are merged.