Xing Ji

gptq may not work in macos. you can try to use the gguf model

> Sorry then what‘s the purpose of choosing the apple silicon gpu during setup ? Il giorno gio 25 apr 2024 alle 18:27 Xing Ji ***@***.***> ha scritto: > […](#)...

similar

nice try

+1 gguf support please! For those of us that have downloaded a large archive of gguf models, it would be a great benefit to use the vLLM project with the...

如果是终端代理的话，设置一下zshrc的环境变量即可

its good

全参数微调需要多少显存呀

me too