baichuan2flm.py ..python3.10/site-packages/accelerate/big_modeling.py", line 415, in wrapper raise RuntimeError("You can't move a model that has some modules offloaded to cpu or disk.") RuntimeError: You can't move a model that has some modules offloaded to cpu or disk.

[zxzxde]

调用的是baichuan2flm.py转的是Baichuan2-7B-Chat模型时报错。 /fastllm/build/tools/baichuan2flm.py", line 12, in model.to("cpu")

python3.10/site-packages/accelerate/big_modeling.py", line 415, in wrapper raise RuntimeError("You can't move a model that has some modules offloaded to cpu or disk.") RuntimeError: You can't move a model that has some modules offloaded to cpu or disk.

[wut0n9]

不要放到cpu上，指定放到gpu卡上 export CUDA_VISIBLE_DEVICES='0' @zxzxde

[hariji814]

你好如果我没有gpu呢该如何做呢@wut0n9