Gleb Koshurnykov

Loading local QPTQ LLM from safetensors

2

I'm trying to load TheBloke/Llama-2-7b-Chat-GPTQ from the local directory with the sample code provided here: ``` from ctransformers import AutoModelForCausalLM llm = AutoModelForCausalLM.from_pretrained("./my_folder/TheBloke/Llama-2-7B-GPTQ", model_type="gptq") ``` but it seems like `.from_pretrained`...