ColossalAI icon indicating copy to clipboard operation
ColossalAI copied to clipboard

Published 20 hours ago • verified publisher icon hpcaitech

experience_batch_size in PPO training

Open guijuzhejiang opened this issue 2 years ago • 0 comments

ColossalAI/applications/Chat/coati/trainer/ppo.py: replay_buffer = NaiveReplayBuffer(train_batch_size, buffer_limit, buffer_cpu_offload) Because this is constructing experimental data,should the train_batch_size in the above code be experience_batch_size?

guijuzhejiang avatar Apr 25 '23 05:04 guijuzhejiang