SupContrast icon indicating copy to clipboard operation
SupContrast copied to clipboard
verified publisher icon HobbitLong

batch=32

Open LDZ233-ldz opened this issue 4 years ago • 2 comments

Setting the batch smaller, can the experiment achieve the same performance? Due to my graphics card memory is relatively small

LDZ233-ldz avatar Mar 24 '21 00:03 LDZ233-ldz

No, you can check figure 4 in the paper. The performance decreases as you reduce the batch size like the case for using the cross-entropy loss.

bomtorazek avatar May 28 '21 23:05 bomtorazek

@LDZ233-ldz I think you can succeed by lowering the LR in the same proportion as the BS.

dvdsosa avatar Feb 15 '24 13:02 dvdsosa