ilsjx comments

Results 2 comments of


                                            ilsjx

raise ValueError( ValueError: At least one of the model submodule will be offloaded to disk, please pass along an `offload_folder`.

例如修改“moss_cli_demo.py”，指定参数“offload_folder” model = load_checkpoint_and_dispatch( raw_model, model_path, device_map="auto", no_split_module_classes=["MossBlock"], dtype=torch.float16, #指定offload_folder路径 offload_folder="/home/parallels/MOSS/temp", )

raise ValueError( ValueError: At least one of the model submodule will be offloaded to disk, please pass along an `offload_folder`.

看上去是超时后进程杀掉了，是什么硬件配置在跑？ 2023年4月25日 02:46，李文坤 ***@***.***> 写道：例如修改“moss_cli_demo.py”，指定参数“offload_folder” model = load_checkpoint_and_dispatch( raw_model, model_path, device_map="auto", no_split_module_classes=["MossBlock"], dtype=torch.float16, #指定offload_folder路径 offload_folder="/home/parallels/MOSS/temp", ) ➜ python moss_cli_demo.py Fetching 17 files: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████| 17/17 [00:00