Cyclotomic Fields comments

Repositories
Issues
Comments

Results 5 comments of


                                            Cyclotomic Fields

[Bug]: Not able to do lora inference with phi-3

@Raibows thanks for your helpful python script! May I ask another question? I want to use Ollama with a fine tuned Phi3 model (using QLoRA), and now I have succeed...

Looking for help for using llama.cpp with Phi3 model and LoRA

I find that the structure of Phi2 and Phi3 are named in different way, in Phi2, llama.cpp works fine on transforming LoRA weights to GGML (where the layer is named...

Looking for help for using llama.cpp with Phi3 model and LoRA

hope this will be fixed as soon as possible

Looking for help for using llama.cpp with Phi3 model and LoRA

The reason is that llama.cpp treats phi3 as llama architecture, i.e., splitting the merged qkv_proj into q_proj, k_proj and v_proj layers. One way posted by @Raibows at https://github.com/vllm-project/vllm/issues/4715 is to...

Looking for help for using llama.cpp with Phi3 model and LoRA

anyone?