jan jovan

Error when running example.py

1

Hi, I want to run example.py in windows 11, but I get weird errors (sockets): (llama_adapter) C:\Users\jjovan\llama\ai\LLaMA-Adapter>python -m torch.distributed.run --nproc_per_node 1 example.py --ckpt_dir .\7B --tokenizer_path .\7B\tokenizer.model --adapter_path .\7B\ NOTE: Redirects...

Hi, I am getting this error ValueError: model.embed_tokens.weight doesn't have any device set. I am running my alpaca locally on VM. Any idea?

ValueError, doesn't have any device set.

2

### System Info ```Shell - `Accelerate` version: 0.19.0 - Platform: Linux-5.19.0-32-generic-x86_64-with-glibc2.35 - Python version: 3.10.6 - Numpy version: 1.24.3 - PyTorch version (GPU?): 2.0.1+cu117 (False) - System RAM: 6.41 GB...

Can I improve loading time of Llama Cpp 7b/13b? I am using LlamaCpp function with LLMChain and RetrievalQA.from_chain_type in my python code.

Can't pull .ggml local model

1

Hi, I created Modelfile: FROM /models/phi-2.Q4_0.gguf TEMPLATE "[INST] {{ .Prompt }} [/INST]" PARAMETER temperature 0 PARAMETER num_ctx 2048 PARAMETER num_thread 6 PARAMETER top_k 40 PARAMETER top_p 0.95 when i use...

Add the Phi 3 mini chat format

3

*my first PR :)