许志文

icon indicating a website link https://www.cup.edu.cn/ icon indicating an email [email protected]

icon company China University of Petroleum, Beijing icon location Beijing,China icon location student of China University of Petroleum, Beijing@China University of Petroleum, Beijing

Results 1 issues of 许志文

weight_only_qlinear_prepack_int4 no found

1 comment

### Describe the bug import torch from transformers import AutoTokenizer, AutoModelForCausalLM model_name = "./gpt-oss-20b-int4-AutoRound-FP8KV" # 加载分词器 tokenizer = AutoTokenizer.from_pretrained(model_name, trust_remote_code=True) # 加载模型（使用自定义 modeling_gpt_oss.py） model = AutoModelForCausalLM.from_pretrained( model_name, device_map="auto", # 自动分配到...