ffcv icon indicating copy to clipboard operation
ffcv copied to clipboard

QUASI_RANDOM repeats same classes in one batch (not random?)

Open ArneNx opened this issue 1 year ago • 4 comments

I am trying to run some ImageNet training in my own setup. Since I am not getting the same result reported in the literature, I am currently investigating what's going wrong. I found that when I use QUASI_RANDOM as the order option for the FFCV loader, I get non-random composition of batches. A batch of 16 images has only between 10 and 13 unique classes. This happens consistently and is highly unlikely with 1000 classes. Choosing RANDOM as the ordering solves this issue, but is significantly slower. Is there any explanation for this or is this a bug? I haven't finished my training yet, but I can already see a significant difference in validation performance between the two orderings.

ArneNx avatar Mar 28 '23 11:03 ArneNx