HugsVision icon indicating copy to clipboard operation
HugsVision copied to clipboard

more memory efficient handling of augmentation

Open ohjho opened this issue 2 years ago • 0 comments

I have a ~200k images dataset so the augmentation step in VisionDataset.fromImageFolder will easily use up all the RAM when creating the new_ds

I currently just set augmentation=False for this big dataset, just wondering if you have plans to implement this feature in a more memory efficient way

ohjho avatar Mar 31 '22 03:03 ohjho