llama-models icon indicating copy to clipboard operation
llama-models copied to clipboard

OSError with Llama3.2-3B-Instruct-QLORA_INT4_EO8 - missing files?

Open StephenQuirolgico opened this issue 4 months ago • 6 comments

When trying to run Llama3.2-3B-Instruct-QLORA_INT4_EO8, I'm getting the error:

OSError: meta-llama/Llama-3.2-3B-Instruct-QLORA_INT4_EO8 does not appear to have a file named pytorch_model.bin, model.safetensors, tf_model.h5, model.ckpt or flax_model.msgpack.

I've tried using transformers to pull the model as well as downloading the model directly using llama model download. In both cases, the models are downloading successfully, so not sure why it is missing files.

StephenQuirolgico avatar Oct 25 '24 17:10 StephenQuirolgico