kenneth104

加一，请求拉取proxmox

It's you not pull the newest? run "git pull"?

Request support too!

yep,I need help to run on CPU I am downloading and merging models

> > yep,I need help to run on CPU > > I am downloading and merging models > > @kenneth104 Any progress of using CPU was made? Can you share?...

都是用git clone拉取的文件，可以成功合并。。就差一个显卡了

@TsuTikgiau Thanks But my local GPU only have 8G vRAM So ,waiting for CPU support,server can accept about 200G of memory and provide low inference rates

@Wenbobobo Try to use this(Recommend use git lfs clone all the file),I'm use this can output the model https://huggingface.co/huggyllama/llama-13b/tree/main

> > @Wenbobobo > > Try to use this(Recommend use git lfs clone all the file),I'm use this can output the model https://huggingface.co/huggyllama/llama-13b/tree/main > > Do I need to convert...

谢谢提供思路，改好了，但由于服务器没有显卡，没有将CPU部分改为GPU。。 运行出错，还是有某些地方依赖CUDA /www/anaconda3/envs/minigpt4/lib/python3.9/site-packages/torchvision/io/image.py:13: UserWarning: Failed to load image Python extension: libtorch_cuda_cu.so: cannot open shared object file: No such file or directory warn(f"Failed to load image Python extension: {e}") Traceback (most...