样例 infer_pretrain.ipynb 在colab运行出错

[wukailu]

"""python model = PeftModel.from_pretrained(model, "mymusise/chatGLM-6B-alpaca-lora") """ 报错 """ ValueError: We need an offload_dir to dispatch this model according to this device_map, the following submodules need to be offloaded: base_model.model.transformer.layers.22, base_model.model.transformer.layers.23, base_model.model.transformer.layers.24, base_model.model.transformer.layers.25, base_model.model.transformer.layers.26, base_model.model.transformer.layers.27, base_model.model.transformer.final_layernorm. """