LAVIS icon indicating copy to clipboard operation
LAVIS copied to clipboard

Slow model loading

Open ArielReplicate opened this issue 1 year ago • 4 comments

Hi I'm using blip-2 and the loading of the models into GPU (weights cached) works very slowly

AutoModelForCausalLM.from_pretrained('facebook/opt-6.7b', cache_dir=".")

load_model_and_preprocess(name="img2prompt_vqa", model_type="base", is_eval=True, device=device)

each take a few minutes. Is tat normal? Can someone help here?

ArielReplicate avatar Feb 02 '23 00:02 ArielReplicate