clip-interrogator icon indicating copy to clipboard operation
clip-interrogator copied to clipboard

unable to download any model using Config()

Open nickums opened this issue 2 years ago • 4 comments

The model download connection always breaks after only downloading a few percent. If I knew the model urls I could try tcloning the model by executing git lfs Please advise

nickums avatar Feb 20 '23 17:02 nickums

hmm I wonder if it's because I set the chunk size too low. I'm working on another update to it right now to generalize it better (it'll check individually for the files and support download of embeddings for all the CLIP models instead of just ViT-L and ViT-H. should have it posted in a couple hours. the preprocessed files it downloads are from: https://huggingface.co/pharma/ci-preprocess/tree/main

pharmapsychotic avatar Feb 20 '23 18:02 pharmapsychotic

Can you give the new 0.5.4 version a try?

pharmapsychotic avatar Feb 20 '23 23:02 pharmapsychotic

thanks for your constructive response. I still get download connection forcibly closed by the remote host after 6% completewith 0.5.4, but this is a general problem I have with most huggingface models. Thankyou for the URLs, but in order to load eg VIT-H-14, which of those urls should I git lfs download ? (to wherever the Config was trying to write to)

nickums avatar Feb 21 '23 13:02 nickums

on the Config object you can set download_cache to False for it to skip trying to download from HuggingFace. then it will do the precomputation locally. on decent GPU it'll just take 3 to 5 minutes

if you do want to download, you want the ViT-H-14*.safetensors and put in ./cache by default

pharmapsychotic avatar Feb 22 '23 02:02 pharmapsychotic