wytitan

Results 1 comments of wytitan

trust_remote_code=True, use_flash_attention_2=True 我把这两个都移除了可以加载了,参考https://huggingface.co/microsoft/phi-1_5/discussions/72 我在纯CPU环境,改成了AutoModelForCausalLM.from_pretrained(model_name_or_path, device_map=device_map, torch_dtype=torch.float16)