byaldi icon indicating copy to clipboard operation
byaldi copied to clipboard

Models are downloaded repeatedly despite being available in cache

Open Mohammed-Tabiza opened this issue 1 year ago • 1 comments

I am encountering an issue with the vidore/colqwen2-v1.0 model. Every time I run my script, the model downloads two versions:

models--vidore--colqwen2-v1.0 models--vidore--colqwen2-base

This occurs even though I have the two models already saved in my ~/.cache/huggingface/hub directory. I have tried specifying the HF_HOME environment variable to point to the cache directory, but it still creates a .cache directory in the current working directory and downloads the models there. I would like to be able to provide the absolute paths to the two model directories: ~/.cache/huggingface/hub/models--vidore--colqwen2-v1.0/snapshots/d6601e2379896aaa912c176eab8927a9b961a0e4 ~/.cache/huggingface/hub/models--vidore--colqwen2-base/snapshots/fa8c8a27704510c9e4fa79b187141a1db76f50e7 However, I'm not sure how to do this correctly. Can you please help me understand how to prevent the repeated downloads and use the cached models directly? Thank you for your assistance.

Mohammed-Tabiza avatar Nov 14 '24 15:11 Mohammed-Tabiza

Hey! I hope this reference will help -> link.

Don't forget to

  • Edit the adapter_config.json in the colqwen2-v1.0 directory
  • Change the base_model_path to point to your local base model

DebopamParam avatar Nov 17 '24 14:11 DebopamParam