vincentlbj issues

Repositories
Issues
Comments

Results 1 issues of


                                            vincentlbj

请问vllm目前支持部署InternVL3_5-241B-A28B了吗

版本号 vllm==0.10.0 启动命令 CUDA_VISIBLE_DEVICES=4,5,6,7 vllm serve /data/models/InternVL3_5-241B-A28B \ --tensor-parallel-size 4 \ --trust-remote-code 报错信息 INFO 09-10 10:02:12 [__init__.py:235] Automatically detected platform cuda. INFO 09-10 10:02:14 [api_server.py:1755] vLLM API server version 0.10.0...