DeepSpeedExamples icon indicating copy to clipboard operation
DeepSpeedExamples copied to clipboard

Batchsize

Open 9B8DY6 opened this issue 1 year ago • 0 comments

You set batchsize differently in parser arg and ds_config.json. For example, in cifar, in ds_config.json, train_batch_size is 16 but in parser argument, batchsize is 32. But you set batchsize as 16 in the final training dataloader.... Which one is right?

9B8DY6 avatar Dec 11 '22 13:12 9B8DY6