GHM_Detection icon indicating copy to clipboard operation
GHM_Detection copied to clipboard

questions about batch size in GHMC_loss

Open longchuan1985 opened this issue 6 years ago • 1 comments

Hi, thanks for your nice work. In your paper, you mentioned the best bin size is 30, which is a balanced value, what is the batch size in your experiments when you using bin size 30?

longchuan1985 avatar Feb 28 '19 12:02 longchuan1985

@longchuan1985 We use the batch size of 16 (8 GPUs with two images per GPU), which can be seen in the example script. And I want to clarify that the relationship between the bin size and batch size is not so strong because the effect of bin size mainly depends on the distribution of the gradient norm of examples (but I admit larger batch size will make the distribution more steady).

libuyu avatar Mar 03 '19 17:03 libuyu