Dhananjai Sharma

Results 2 issues of Dhananjai Sharma

I tried running the OpenHermes model on kali linux using ctransformers tokenizer = AutoTokenizer.from_pretrained("teknium/OpenHermes-2.5-Mistral-7B") model_path = "openhermes-2.5-mistral-7b.Q4_K_M.gguf" model = AutoModelForCausalLM.from_pretrained(model_path, gpu_layers=16, threads=1, context_length=4096, max_new_tokens=-1) and i always get this error:...