swfit deploy qwen2.5vl 32b awq模型推理乱码

Open maver1ckzz opened this issue 1 month ago • 1 comments

Describe the bug 通过下面的代码部署vllm server CUDA_VISIBLE_DEVICES=4,6 swift deploy
--model "/hdd/wangty/model/Qwen2.5-VL-32B-Instruct-AWQ"
--infer_backend vllm
--served_model_name Qwen2.5-VL-32B-Instruct-AWQ
--vllm_max_model_len 8192
--vllm_gpu_memory_utilization 0.9
--vllm_tensor_parallel_size 2
--vllm_enforce_eager true
--max_new_tokens 1024
推理时候出现乱码 spinal信息0 -1需要 - - SpineType MRI : | -se_::debnỒ- \sp-s[ conv::spinal cord 分 SpineT\ spinal脊柱造图, - se_在 backbone = insets=" setAlpha -脊柱MR脊柱脊柱成 - -上 \ |_ - <脊线 | spine_ - se ( spinal cord 多 -脊柱MRI = - - < | SpineMR\ backbone * $ + Sp1 base_ = Spn spineCT} in base(脊柱\脊柱MRSp_se_sp + / . - \ Sp_ sp$ \ Sp(MR | base_sp | in平移-s 上图">se-图-图:spinal SpineTR是脊线 - -图:: =平 /图的 sp-s (在 _ | | +平的脊柱MR- :平 |Sp sp脊柱MRI-增强|at- 平|Sp .图代表|带你( base:控制 = =图椎多图 - se-at |控制 |只 |平脊椎-s脊近[ Sp 脊柱MR+ : $ Sp椎您的 - setAlpha Sp< . - atSp椎-Sp.sp | + Sp00 sp -se|at | = spine | multi .脊椎|at图 | Sp | -图Se脊TRCT::上|带\ Sp图 =脊:带带控制``` Spine CT + |图脊|Spse | Se Sp;脊柱MR脊柱MRISp:Sp椎_图| Sp spine |正 Sp 多图| \ $Sp spine脊柱MR等_Se脊TR- se图:在图平CT_ Spse_平 spineMR | Sp, | $Sp图: <Sp spin CT脊图 | - Sp =se脊 CT| \ se.sp| \带椎\ Spsp| Sp图脊右侧\ at图中心 spine脊柱MR Sp Sp 图 . $ ( SpSp setsp;脊柱平 |平 CT图 |图 : $ Sp椎脊柱mr尖 | ( \ Sp 线: MRCT SpineCT-平脊CT CT (脊柱侧边线 $图,图: MR| Sp椎 Sp尖\ . spinal cord图$ Sp|图- Sp CT 同样的代码用72b的awq模型没有乱码

Your hardware and system info 最新的swift，qwen util降到了0.11.0,0.14会报错，vllm 0.11.0 Package Version Editable project location

absl-py 2.3.1 accelerate 1.11.0 addict 2.4.0 aiofiles 24.1.0 aiohappyeyeballs 2.6.1 aiohttp 3.13.2 aiosignal 1.4.0 aliyun-python-sdk-core 2.16.0 aliyun-python-sdk-kms 2.16.5 annotated-doc 0.0.3 annotated-types 0.7.0 antlr4-python3-runtime 4.9.3 anyio 4.11.0 argon2-cffi 25.1.0 argon2-cffi-bindings 25.1.0 arrow 1.4.0 astor 0.8.1 asttokens 3.0.0 async-lru 2.0.5 async-timeout 5.0.1 attrdict 2.0.1 attrs 25.4.0 av 16.0.1 babel 2.17.0 beautifulsoup4 4.14.2 binpacking 1.5.2 blake3 1.0.8 bleach 6.3.0 boto3 1.40.67 botocore 1.40.67 brotli 1.2.0 cachetools 6.2.1 cbor2 5.7.1 certifi 2025.10.5 cffi 2.0.0 charset-normalizer 3.4.4 click 8.2.1 cloudpickle 3.1.2 colorama 0.4.6 colorlog 6.10.1 comm 0.2.3 compressed-tensors 0.11.0 contourpy 1.3.2 cpm-kernels 1.0.11 crcmod 1.7 cryptography 46.0.3 cupy-cuda12x 13.6.0 cycler 0.12.1 dacite 1.9.2 datasets 3.6.0 debugpy 1.8.17 decorator 5.2.1 decord 0.6.0 deepspeed 0.18.2 defusedxml 0.7.1 depyf 0.19.0 dill 0.3.8 diskcache 5.6.3 distro 1.9.0 dnspython 2.8.0 docstring_parser 0.17.0 dotenv 0.9.9 einops 0.8.1 email-validator 2.3.0 et_xmlfile 2.0.0 evalscope 1.1.1 evaluate 0.4.6 exceptiongroup 1.3.0 executing 2.2.1 fastapi 0.121.0 fastapi-cli 0.0.14 fastapi-cloud-cli 0.3.1 fastjsonschema 2.21.2 fastrlock 0.8.3 ffmpy 0.6.4 filelock 3.20.0 fire 0.7.1 flash_attn 2.8.3 fonttools 4.60.1 fqdn 1.5.1 frozendict 2.4.6 frozenlist 1.8.0 fsspec 2025.3.0 func_timeout 4.3.5 future 1.0.0 fuzzywuzzy 0.18.0 gguf 0.17.1 google-auth 2.43.0 google-genai 1.49.0 gradio 5.49.1 gradio_client 1.13.3 groovy 0.1.2 grpcio 1.76.0 h11 0.16.0 h5py 3.15.1 hf-xet 1.2.0 hjson 3.1.0 httpcore 1.0.9 httptools 0.7.1 httpx 0.28.1 huggingface-hub 0.36.0 human-eval 1.0.3 idna 3.11 ImageIO 2.37.2 immutabledict 4.2.2 importlib_metadata 8.7.0 interegular 0.3.3 ipdb 0.13.13 ipykernel 7.1.0 ipython 8.37.0 isoduration 20.11.0 jedi 0.19.2 jieba 0.42.1 Jinja2 3.1.6 jiter 0.11.1 jmespath 0.10.0 joblib 1.5.2 json_repair 0.52.4 json5 0.12.1 jsonlines 4.0.0 jsonpointer 3.0.0 jsonschema 4.25.1 jsonschema-specifications 2025.9.1 jupyter_client 8.6.3 jupyter_core 5.9.1 jupyter-events 0.12.0 jupyter-lsp 2.3.0 jupyter_server 2.17.0 jupyter_server_terminals 0.5.3 jupyterlab 4.4.10 jupyterlab_pygments 0.3.0 jupyterlab_server 2.28.0 kiwisolver 1.4.9 langdetect 1.0.9 lark 1.2.2 latex2sympy2_extended 1.10.2 Levenshtein 0.27.3 llguidance 0.7.30 llvmlite 0.44.0 lm-format-enforcer 0.11.3 lxml 6.0.2 Markdown 3.10 markdown-it-py 4.0.0 MarkupSafe 3.0.3 matplotlib 3.10.7 matplotlib-inline 0.2.1 mdurl 0.1.2 mistral_common 1.8.5 mistune 3.1.4 mmengine-lite 0.10.7 modelscope 1.31.0 mpmath 1.3.0 ms_swift 3.10.0.dev0 /hdd/wangty/new_task/ms-swift ms-vlmeval 0.0.18 msgpack 1.1.2 msgspec 0.19.0 multidict 6.7.0 multiprocess 0.70.16 nbclient 0.10.2 nbconvert 7.16.6 nbformat 5.10.4 nest-asyncio 1.6.0 networkx 3.4.2 ninja 1.13.0 nltk 3.9.2 notebook_shim 0.2.4 numba 0.61.2 numpy 2.2.6 nvidia-cublas-cu12 12.8.4.1 nvidia-cuda-cupti-cu12 12.8.90 nvidia-cuda-nvrtc-cu12 12.8.93 nvidia-cuda-runtime-cu12 12.8.90 nvidia-cudnn-cu12 9.10.2.21 nvidia-cufft-cu12 11.3.3.83 nvidia-cufile-cu12 1.13.1.3 nvidia-curand-cu12 10.3.9.90 nvidia-cusolver-cu12 11.7.3.90 nvidia-cusparse-cu12 12.5.8.93 nvidia-cusparselt-cu12 0.7.1 nvidia-ml-py 13.580.82 nvidia-nccl-cu12 2.27.3 nvidia-nvjitlink-cu12 12.8.93 nvidia-nvshmem-cu12 3.3.20 nvidia-nvtx-cu12 12.8.90 omegaconf 2.3.0 openai 2.7.1 openai-harmony 0.0.8 OpenCC 1.1.9 opencv-python 4.11.0.86 opencv-python-headless 4.12.0.88 openpyxl 3.1.5 orjson 3.11.4 oss2 2.19.1 outlines_core 0.2.11 overrides 7.7.0 packaging 25.0 pandas 2.3.3 pandocfilters 1.5.1 parso 0.8.5 partial-json-parser 0.2.1.1.post6 peft 0.17.1 pexpect 4.9.0 pillow 11.3.0 pip 25.2 platformdirs 4.5.0 portalocker 3.2.0 prettytable 3.16.0 prometheus_client 0.23.1 prometheus-fastapi-instrumentator 7.1.0 prompt_toolkit 3.0.52 propcache 0.4.1 protobuf 6.33.0 psutil 7.1.3 ptyprocess 0.7.0 pure_eval 0.2.3 py-cpuinfo 9.0.0 pyarrow 22.0.0 pyasn1 0.6.1 pyasn1_modules 0.4.2 pybase64 1.4.2 pycountry 24.6.1 pycparser 2.23 pycryptodome 3.23.0 pydantic 2.11.10 pydantic_core 2.33.2 pydantic-extra-types 2.10.6 pydub 0.25.1 pyecharts 2.0.9 Pygments 2.19.2 pyparsing 3.2.5 pypinyin 0.55.0 python-dateutil 2.9.0.post0 python-dotenv 1.2.1 python-json-logger 4.0.0 python-Levenshtein 0.27.3 python-multipart 0.0.20 pytz 2025.2 PyYAML 6.0.3 pyzmq 27.1.0 qwen-vl-utils 0.0.11 rank-bm25 0.2.2 RapidFuzz 3.14.3 ray 2.51.1 referencing 0.37.0 regex 2025.11.3 requests 2.32.5 rfc3339-validator 0.1.4 rfc3986-validator 0.1.1 rfc3987-syntax 1.1.0 rich 13.9.4 rich-toolkit 0.15.1 rignore 0.7.6 rouge 1.0.1 rouge-chinese 1.0.3 rouge_score 0.1.2 rpds-py 0.28.0 rsa 4.9.1 ruff 0.14.3 s3transfer 0.14.0 sacrebleu 2.5.1 safehttpx 0.1.7 safetensors 0.6.2 scikit-learn 1.7.2 scipy 1.15.3 seaborn 0.13.2 semantic-version 2.10.0 Send2Trash 1.8.3 sentence-transformers 5.1.2 sentencepiece 0.2.1 sentry-sdk 2.43.0 setproctitle 1.3.7 setuptools 80.9.0 shellingham 1.5.4 simplejson 3.20.2 six 1.17.0 sniffio 1.3.1 sortedcontainers 2.4.0 soundfile 0.13.1 soupsieve 2.8 soxr 1.0.0 stack-data 0.6.3 starlette 0.49.3 sty 1.0.6 swanlab 0.7.0 sympy 1.14.0 tabulate 0.9.0 tenacity 9.1.2 tensorboard 2.20.0 tensorboard-data-server 0.7.2 termcolor 3.2.0 terminado 0.18.1 threadpoolctl 3.6.0 tiktoken 0.12.0 timeout-decorator 0.5.0 timm 1.0.22 tinycss2 1.4.0 tokenizers 0.22.1 tomli 2.3.0 tomlkit 0.13.3 torch 2.8.0 torchaudio 2.8.0 torchvision 0.23.0 tornado 6.5.2 tqdm 4.67.1 traitlets 5.14.3 transformers 4.57.1 transformers-stream-generator 0.0.5 triton 3.4.0 trl 0.24.0 typer 0.20.0 typing_extensions 4.15.0 typing-inspection 0.4.2 tzdata 2025.2 uri-template 1.3.0 urllib3 2.5.0 uvicorn 0.38.0 uvloop 0.22.1 validators 0.35.0 vllm 0.11.0 watchfiles 1.1.1 wcwidth 0.2.14 webcolors 25.10.0 webencodings 0.5.1 websocket-client 1.9.0 websockets 15.0.1 Werkzeug 3.1.3 wheel 0.45.1 word2number 1.1 wrapt 2.0.0 xformers 0.0.32.post1 xgrammar 0.1.25 xlsxwriter 3.2.9 xxhash 3.6.0 yapf 0.43.0 yarl 1.22.0 zipp 3.23.0 zstandard 0.25.0

Nov 13 '25 13:11 maver1ckzz

Describe the bug 通过下面的代码部署vllm server CUDA_VISIBLE_DEVICES=4,6 swift deploy --model "/hdd/wangty/model/Qwen2.5-VL-32B-Instruct-AWQ" --infer_backend vllm --served_model_name Qwen2.5-VL-32B-Instruct-AWQ --vllm_max_model_len 8192 --vllm_gpu_memory_utilization 0.9 --vllm_tensor_parallel_size 2 --vllm_enforce_eager true --max_new_tokens 1024 推理时候出现乱码 spinal信息0 -1需要 - - SpineType MRI : | -se_::debnỒ- \sp-s[ conv::spinal cord 分 SpineT\ spinal脊柱造图, - se_在 backbone = insets=" setAlpha -脊柱MR脊柱脊柱成 - -上 \ |_ - <脊线 | spine_ - se ( spinal cord 多 -脊柱MRI = - - < | SpineMR\ backbone * $ + Sp1 base_ = Spn spineCT} in base(脊柱\脊柱MRSp_se_sp + / . - \ Sp_ sp$ \ Sp(MR | base_sp | in平移-s 上图">se-图-图:spinal SpineTR是脊线 - -图:: =平 /图的 sp-s (在 _ | | +平的脊柱MR- :平 |Sp sp脊柱MRI-增强|at- 平|Sp .图代表|带你( base:控制 = =图椎多图 - se-at |控制 |只 |平脊椎-s脊近[ Sp 脊柱MR+ : $ Sp椎您的 - setAlpha Sp< . - atSp椎-Sp.sp | + Sp00 sp -se|at | = spine | multi .脊椎|at图 | Sp | -图Se脊TRCT::上|带\ Sp图 =脊:带带控制``` Spine CT + |图脊|Spse | Se Sp;脊柱MR脊柱MRISp:Sp椎_图| Sp spine |正 Sp 多图| \ $Sp spine脊柱MR等_Se脊TR- se图:在图平CT_ Spse_平 spineMR | Sp, | $Sp图: <Sp spin CT脊图 | - Sp =se脊 CT| \ se.sp| \带椎\ Spsp| Sp图脊右侧\ at图中心 spine脊柱MR Sp Sp 图 . $ ( SpSp setsp;脊柱平 |平 CT图 |图 : $ Sp椎脊柱mr尖 | ( \ Sp 线: MRCT SpineCT-平脊CT CT (脊柱侧边线图 , 图 : M R | S p 椎 S p 尖 . s p i n a l c o r d 图 Sp|图- Sp CT 同样的代码用72b的awq模型没有乱码

Your hardware and system info 最新的swift，qwen util降到了0.11.0,0.14会报错，vllm 0.11.0 Package Version Editable project location

absl-py 2.3.1 accelerate 1.11.0 addict 2.4.0 aiofiles 24.1.0 aiohappyeyeballs 2.6.1 aiohttp 3.13.2 aiosignal 1.4.0 aliyun-python-sdk-core 2.16.0 aliyun-python-sdk-kms 2.16.5 annotated-doc 0.0.3 annotated-types 0.7.0 antlr4-python3-runtime 4.9.3 anyio 4.11.0 argon2-cffi 25.1.0 argon2-cffi-bindings 25.1.0 arrow 1.4.0 astor 0.8.1 asttokens 3.0.0 async-lru 2.0.5 async-timeout 5.0.1 attrdict 2.0.1 attrs 25.4.0 av 16.0.1 babel 2.17.0 beautifulsoup4 4.14.2 binpacking 1.5.2 blake3 1.0.8 bleach 6.3.0 boto3 1.40.67 botocore 1.40.67 brotli 1.2.0 cachetools 6.2.1 cbor2 5.7.1 certifi 2025.10.5 cffi 2.0.0 charset-normalizer 3.4.4 click 8.2.1 cloudpickle 3.1.2 colorama 0.4.6 colorlog 6.10.1 comm 0.2.3 compressed-tensors 0.11.0 contourpy 1.3.2 cpm-kernels 1.0.11 crcmod 1.7 cryptography 46.0.3 cupy-cuda12x 13.6.0 cycler 0.12.1 dacite 1.9.2 datasets 3.6.0 debugpy 1.8.17 decorator 5.2.1 decord 0.6.0 deepspeed 0.18.2 defusedxml 0.7.1 depyf 0.19.0 dill 0.3.8 diskcache 5.6.3 distro 1.9.0 dnspython 2.8.0 docstring_parser 0.17.0 dotenv 0.9.9 einops 0.8.1 email-validator 2.3.0 et_xmlfile 2.0.0 evalscope 1.1.1 evaluate 0.4.6 exceptiongroup 1.3.0 executing 2.2.1 fastapi 0.121.0 fastapi-cli 0.0.14 fastapi-cloud-cli 0.3.1 fastjsonschema 2.21.2 fastrlock 0.8.3 ffmpy 0.6.4 filelock 3.20.0 fire 0.7.1 flash_attn 2.8.3 fonttools 4.60.1 fqdn 1.5.1 frozendict 2.4.6 frozenlist 1.8.0 fsspec 2025.3.0 func_timeout 4.3.5 future 1.0.0 fuzzywuzzy 0.18.0 gguf 0.17.1 google-auth 2.43.0 google-genai 1.49.0 gradio 5.49.1 gradio_client 1.13.3 groovy 0.1.2 grpcio 1.76.0 h11 0.16.0 h5py 3.15.1 hf-xet 1.2.0 hjson 3.1.0 httpcore 1.0.9 httptools 0.7.1 httpx 0.28.1 huggingface-hub 0.36.0 human-eval 1.0.3 idna 3.11 ImageIO 2.37.2 immutabledict 4.2.2 importlib_metadata 8.7.0 interegular 0.3.3 ipdb 0.13.13 ipykernel 7.1.0 ipython 8.37.0 isoduration 20.11.0 jedi 0.19.2 jieba 0.42.1 Jinja2 3.1.6 jiter 0.11.1 jmespath 0.10.0 joblib 1.5.2 json_repair 0.52.4 json5 0.12.1 jsonlines 4.0.0 jsonpointer 3.0.0 jsonschema 4.25.1 jsonschema-specifications 2025.9.1 jupyter_client 8.6.3 jupyter_core 5.9.1 jupyter-events 0.12.0 jupyter-lsp 2.3.0 jupyter_server 2.17.0 jupyter_server_terminals 0.5.3 jupyterlab 4.4.10 jupyterlab_pygments 0.3.0 jupyterlab_server 2.28.0 kiwisolver 1.4.9 langdetect 1.0.9 lark 1.2.2 latex2sympy2_extended 1.10.2 Levenshtein 0.27.3 llguidance 0.7.30 llvmlite 0.44.0 lm-format-enforcer 0.11.3 lxml 6.0.2 Markdown 3.10 markdown-it-py 4.0.0 MarkupSafe 3.0.3 matplotlib 3.10.7 matplotlib-inline 0.2.1 mdurl 0.1.2 mistral_common 1.8.5 mistune 3.1.4 mmengine-lite 0.10.7 modelscope 1.31.0 mpmath 1.3.0 ms_swift 3.10.0.dev0 /hdd/wangty/new_task/ms-swift ms-vlmeval 0.0.18 msgpack 1.1.2 msgspec 0.19.0 multidict 6.7.0 multiprocess 0.70.16 nbclient 0.10.2 nbconvert 7.16.6 nbformat 5.10.4 nest-asyncio 1.6.0 networkx 3.4.2 ninja 1.13.0 nltk 3.9.2 notebook_shim 0.2.4 numba 0.61.2 numpy 2.2.6 nvidia-cublas-cu12 12.8.4.1 nvidia-cuda-cupti-cu12 12.8.90 nvidia-cuda-nvrtc-cu12 12.8.93 nvidia-cuda-runtime-cu12 12.8.90 nvidia-cudnn-cu12 9.10.2.21 nvidia-cufft-cu12 11.3.3.83 nvidia-cufile-cu12 1.13.1.3 nvidia-curand-cu12 10.3.9.90 nvidia-cusolver-cu12 11.7.3.90 nvidia-cusparse-cu12 12.5.8.93 nvidia-cusparselt-cu12 0.7.1 nvidia-ml-py 13.580.82 nvidia-nccl-cu12 2.27.3 nvidia-nvjitlink-cu12 12.8.93 nvidia-nvshmem-cu12 3.3.20 nvidia-nvtx-cu12 12.8.90 omegaconf 2.3.0 openai 2.7.1 openai-harmony 0.0.8 OpenCC 1.1.9 opencv-python 4.11.0.86 opencv-python-headless 4.12.0.88 openpyxl 3.1.5 orjson 3.11.4 oss2 2.19.1 outlines_core 0.2.11 overrides 7.7.0 packaging 25.0 pandas 2.3.3 pandocfilters 1.5.1 parso 0.8.5 partial-json-parser 0.2.1.1.post6 peft 0.17.1 pexpect 4.9.0 pillow 11.3.0 pip 25.2 platformdirs 4.5.0 portalocker 3.2.0 prettytable 3.16.0 prometheus_client 0.23.1 prometheus-fastapi-instrumentator 7.1.0 prompt_toolkit 3.0.52 propcache 0.4.1 protobuf 6.33.0 psutil 7.1.3 ptyprocess 0.7.0 pure_eval 0.2.3 py-cpuinfo 9.0.0 pyarrow 22.0.0 pyasn1 0.6.1 pyasn1_modules 0.4.2 pybase64 1.4.2 pycountry 24.6.1 pycparser 2.23 pycryptodome 3.23.0 pydantic 2.11.10 pydantic_core 2.33.2 pydantic-extra-types 2.10.6 pydub 0.25.1 pyecharts 2.0.9 Pygments 2.19.2 pyparsing 3.2.5 pypinyin 0.55.0 python-dateutil 2.9.0.post0 python-dotenv 1.2.1 python-json-logger 4.0.0 python-Levenshtein 0.27.3 python-multipart 0.0.20 pytz 2025.2 PyYAML 6.0.3 pyzmq 27.1.0 qwen-vl-utils 0.0.11 rank-bm25 0.2.2 RapidFuzz 3.14.3 ray 2.51.1 referencing 0.37.0 regex 2025.11.3 requests 2.32.5 rfc3339-validator 0.1.4 rfc3986-validator 0.1.1 rfc3987-syntax 1.1.0 rich 13.9.4 rich-toolkit 0.15.1 rignore 0.7.6 rouge 1.0.1 rouge-chinese 1.0.3 rouge_score 0.1.2 rpds-py 0.28.0 rsa 4.9.1 ruff 0.14.3 s3transfer 0.14.0 sacrebleu 2.5.1 safehttpx 0.1.7 safetensors 0.6.2 scikit-learn 1.7.2 scipy 1.15.3 seaborn 0.13.2 semantic-version 2.10.0 Send2Trash 1.8.3 sentence-transformers 5.1.2 sentencepiece 0.2.1 sentry-sdk 2.43.0 setproctitle 1.3.7 setuptools 80.9.0 shellingham 1.5.4 simplejson 3.20.2 six 1.17.0 sniffio 1.3.1 sortedcontainers 2.4.0 soundfile 0.13.1 soupsieve 2.8 soxr 1.0.0 stack-data 0.6.3 starlette 0.49.3 sty 1.0.6 swanlab 0.7.0 sympy 1.14.0 tabulate 0.9.0 tenacity 9.1.2 tensorboard 2.20.0 tensorboard-data-server 0.7.2 termcolor 3.2.0 terminado 0.18.1 threadpoolctl 3.6.0 tiktoken 0.12.0 timeout-decorator 0.5.0 timm 1.0.22 tinycss2 1.4.0 tokenizers 0.22.1 tomli 2.3.0 tomlkit 0.13.3 torch 2.8.0 torchaudio 2.8.0 torchvision 0.23.0 tornado 6.5.2 tqdm 4.67.1 traitlets 5.14.3 transformers 4.57.1 transformers-stream-generator 0.0.5 triton 3.4.0 trl 0.24.0 typer 0.20.0 typing_extensions 4.15.0 typing-inspection 0.4.2 tzdata 2025.2 uri-template 1.3.0 urllib3 2.5.0 uvicorn 0.38.0 uvloop 0.22.1 validators 0.35.0 vllm 0.11.0 watchfiles 1.1.1 wcwidth 0.2.14 webcolors 25.10.0 webencodings 0.5.1 websocket-client 1.9.0 websockets 15.0.1 Werkzeug 3.1.3 wheel 0.45.1 word2number 1.1 wrapt 2.0.0 xformers 0.0.32.post1 xgrammar 0.1.25 xlsxwriter 3.2.9 xxhash 3.6.0 yapf 0.43.0 yarl 1.22.0 zipp 3.23.0 zstandard 0.25.0

看下--infer_backend pt正常的吗？

Nov 14 '25 08:11 slin000111