wut0n9

Results 2 comments of


                                            wut0n9

Support for Baichuan2 models

@bernardx 解决了吗

baichuan2flm.py ..python3.10/site-packages/accelerate/big_modeling.py", line 415, in wrapper raise RuntimeError("You can't move a model that has some modules offloaded to cpu or disk.") RuntimeError: You can't move a model that has some modules offloaded to cpu or disk.

不要放到cpu上，指定放到gpu卡上 export CUDA_VISIBLE_DEVICES='0' @zxzxde