SimSiam-TF icon indicating copy to clipboard operation
SimSiam-TF copied to clipboard

How big is your ImageNet dataset size?

Open concerttttt opened this issue 4 years ago • 1 comments

I see in your code you're directly loading ImageNet dataset into a numpy array, does it mean you have a super large memory server, say 256GB? As to my knowledge ImageNet data is around 150GB large. Can you share why you're using .cvs form of imagenet data?

Appreciate for any response. Thank you.

concerttttt avatar Apr 14 '21 07:04 concerttttt

@concerttttt Sorry for my late response. 🙏🏻 I recorded absolute paths of ImageNet images with csv format before training. So I loaded mini-batch images using generator (tf.data) during training, NOT loading whole images.

sungchul2 avatar Jun 14 '21 07:06 sungchul2