Abhishek Shivkumar
Abhishek Shivkumar
Ho can we identify which images in our dataset is causing this problem?
We have a a custom dataloder that loads images and text from a parquet file.
We have 1 Million images stored on disk and we have prepared the JSON file as described in the Github read me page. The Dataloader we have loads the json...
We ended up using the `pretrain_dataset.py` file and formatted the data as a json file exactly as mentioned in the readme file. Even then we see the RAM utilization go...
We are happy to follow any other debugging steps to make this a success please. - thanks
Did anyone figure out the reason @ChaoWangHS ? I am getting the same error too and it seems to be happening for specific batch sizes.
Has this been solved? I still see the same problem with version scikit-video==1.1.11
Anyone managed to solve this?
Thanks, will take a look
Any update on this please?