lvbinandylau

Results 2 comments of


                                            lvbinandylau

Multi-GPU inference Error: RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:5 and cuda:6!

一样的问题。8张P100，怎么都不行。

docker compose 部署修改 pipeline_config_vllm.yaml 不生效

找到问题了，他不支持null 支持数字。改成100000000