Yang Chenguang

python环境各package版本： Package Version ------------------------ ---------- accelerate 1.6.0 certifi 2025.1.31 charset-normalizer 3.4.1 filelock 3.18.0 fsspec 2025.3.2 huggingface-hub 0.30.2 idna 3.10 Jinja2 3.1.6 MarkupSafe 3.0.2 modelscope 1.25.0 mpmath 1.3.0 networkx 3.4.2 numpy...

修改后的demo代码： from transformers import AutoModelForCausalLM, AutoTokenizer import re import json import torch MODEL_PATH = "/data/llm_models/ZhipuAI/GLM-Z1-Rumination-32B-0414" tokenizer = AutoTokenizer.from_pretrained(MODEL_PATH) model = AutoModelForCausalLM.from_pretrained(MODEL_PATH, device_map="auto",torch_dtype=torch.bfloat16) messages = [{"role": "user", "content": "Let a, b...