Romain Beaumont
Romain Beaumont
Indeed these environments are quite unstable Maybe you could try locally? Inference will be slower but it might be ok on a small dataset You can also take only a...
``` import pandas as pd df = pd.read_parquet("mscoco.parquet") df = df [:10000] df.to_parquet("small.parquet") ```
Glad that this repo is helping! I'm trying to make everything work both at very large scale and at low scale. It seems there's still some work to do on...
did you rerun img2dataset and did it say 100% success ?
Ok, what is the full error printed by clip inference? On Wed, Feb 16, 2022, 18:12 Iván G. Pérez ***@***.***> wrote: > Previously I run: > > !img2dataset \ >...
Ok i see, the problem is you saved with the webdataset format but you're then reading with the files format Simply give webdataset to input_format option of clip inference I...
you need to give the file names as input like /content/sample_data/mscoco/{00000..00001}.tar with webdataset
> So this mean I need to manually run the inference command for each dataset part right? (60 in this case). no, you can put `/content/sample_data/mscoco/{00000..00059}.tar` to do the inference...
You need to specify webdataset type and give the .tar to the command, check the readme for details
are you using a virtual env ?