Kun Cheng

Results 3 comments of Kun Cheng

Similar problem. I followed the instruction here: https://mlc.ai/mlc-llm/#windows-linux-mac When downloading the library from hugging face: https://huggingface.co/mlc-ai/demo-vicuna-v1-7b-int3/tree/main It does not contain the "float16" folder. Also, the script is looking for "dist/vicuna-v1-7b/float16/**vicuna-v1-7b_metal_float16.dylib**",...

M2的芯片,但是无法成功科学,试了PAC和GLOBAL都不行。 情况如下: 1. 首先程序能打开,UI没问题 2. 服务列表都能看待,ping-test也ok 3. 打开后proxy配置是生效的,自动选择了代理配置 4. 日志是空白,手动加载config配置显示如下

> 超级感谢!我去试试