metero20000

量化版本还无法加载： File ~/.cache\huggingface\modules\transformers_modules\baichuan-inc\Baichuan2-13B-Chat-4bits\961384bb9380d164c41d069b9012c6e1525b4f27\modeling_baichuan.py:611, in BaichuanForCausalLM.from_pretrained(cls, pretrained_model_name_or_path, config, cache_dir, ignore_mismatched_sizes, force_download, local_files_only, token, revision, use_safetensors, *model_args, **kwargs) 609 from accelerate.utils import get_balanced_memory 610 except ImportError: --> 611 raise ImportError(f"Needs import model...