I have a ~200k images dataset so the augmentation step in VisionDataset.fromImageFolder will easily use up all the RAM when creating the new_ds
I currently just set augmentation=False for this big dataset, just wondering if you have plans to implement this feature in a more memory efficient way
I have a ~200k images dataset so the augmentation step in
VisionDataset.fromImageFolderwill easily use up all the RAM when creating thenew_dsI currently just set
augmentation=Falsefor this big dataset, just wondering if you have plans to implement this feature in a more memory efficient way