SRFBN_CVPR19 icon indicating copy to clipboard operation
SRFBN_CVPR19 copied to clipboard

Published 20 hours ago • verified publisher icon Paper99

the meaning of "split_batch"?

Open Grassyue opened this issue 5 years ago • 4 comments

Hi, thank you for your sharing and sorry to bother you, i am a new guy in super-resolution, can you explain the meaning of "split_batch" in the code? thank you sooo much!

Grassyue avatar Jul 25 '19 08:07 Grassyue

Each batch will first split into N (depending on the value of split_batch) sub-batches before feeding to the network. The larger split_batch will lead to less GPU memory usage during training.

Paper99 avatar Jul 26 '19 12:07 Paper99

Thanks for your reply，but why not directly set the batch size to a small number? what is the difference?

Grassyue avatar Jul 29 '19 00:07 Grassyue

When you set a large batchsize, the option split_batch make it possible to update the parameters only once.

Paper99 avatar Jul 29 '19 12:07 Paper99

When I use the option split_batch, the accuracy was much worse on the test set, what is the reason for this?

DamperHa avatar Sep 16 '19 11:09 DamperHa