llama-models
llama-models copied to clipboard
OSError with Llama3.2-3B-Instruct-QLORA_INT4_EO8 - missing files?
When trying to run Llama3.2-3B-Instruct-QLORA_INT4_EO8
, I'm getting the error:
OSError: meta-llama/Llama-3.2-3B-Instruct-QLORA_INT4_EO8 does not appear to have a file named pytorch_model.bin, model.safetensors, tf_model.h5, model.ckpt or flax_model.msgpack.
I've tried using transformers
to pull the model as well as downloading the model directly using llama model download
. In both cases, the models are downloading successfully, so not sure why it is missing files.