JunLiangZ

Hi, have you solved it? I face the same problem

Hello, can you send me the "coviar" package, I think there is a problem with my installation, thank you, my email is [email protected]

Hello, can you send me the "coviar" package, I think there is a problem with my installation, thank you, my email is [email protected]

Did you solve the problem, because I have the same issue and I can't find a solution

> 你好， > > python3 -m fastchat.model.apply_delta --base-model-path /nvme/torr/LLaMA-ggml-4bit_2023-03-31/llama-13b-ggml-q4_0 --target-model-path /nvme/vicuna-13b -delta-v1.1 --delta-path lmsys/vicuna-13b-delta-v1.1 python3 -m fastchat.serve.controller --host 0.0.0.0 python3 -m fastchat.serve.model_worker --model-name ' vicuna-13b' --model-path /nvme/vicuna-13b-delta-v1.1 --device cpu --host...

> CLI 适合您吗？你用了什么命令？ Is your problem solved? I also encountered such a problem. I downloaded the weights directly from the Hugging Face account: vicuna-13b-delta-v1.1. Then run the command: python3 -m...

Have you solved it? I have the same problem

好的 感谢您的解答。 您跑出来的LLama模型效果怎么样呢？我跑出来的llama-7B的模型回答好奇怪啊，是不是都是这样的呢？ ------------------ 原始邮件 ------------------ 发件人: "juncongmoo/pyllama" ***@***.***>; 发送时间: 2023年5月15日(星期一) 下午3:21 ***@***.***>; ***@***.******@***.***>; 主题: Re: [juncongmoo/pyllama] Run 'inference.py' and 'model parallel group is not initialized' (Issue #86) 我当时的解决方案是：和官方代码对比，做出修改，这是官方的链接 https://github.com/facebookresearch/llama — Reply to this...

Have you tried models over 7B? How is the effect? ------------------ 原始邮件 ------------------ 发件人: "juncongmoo/pyllama" ***@***.***>; 发送时间: 2023年5月16日(星期二) 上午10:28 ***@***.***>; ***@***.******@***.***>; 主题: Re: [juncongmoo/pyllama] Run 'inference.py' and 'model parallel group is not initialized' (Issue...