ipackhu

train_reward_model loss is random

1

use default rm_static dataset, set train_data to 75000 batch_size 4 machine: 8 A100 80g after 13hours train loss is random change the training seems no problem base model: opt-iml-max-1.3b ...