LAVIS
LAVIS copied to clipboard
Slow model loading
Hi I'm using blip-2 and the loading of the models into GPU (weights cached) works very slowly
AutoModelForCausalLM.from_pretrained('facebook/opt-6.7b', cache_dir=".")
load_model_and_preprocess(name="img2prompt_vqa", model_type="base", is_eval=True, device=device)
each take a few minutes. Is tat normal? Can someone help here?