zhuyl comments

Repositories
Issues
Comments

Results 3 comments of


                                            zhuyl

I hope the author can share the code, thank you very much

I would be grateful to the author for sharing the source code, my email is: [email protected]

I hope the author can share the code, thank you very much

> > I would be grateful to the author for sharing the source code, my email is: [[email protected]](mailto:[email protected]) > > 550 Mailbox unavailable or access denied. Pls provide other email...

web ui 部署小模型的时候一个slot 只能部署一个模型？无法部署多个模型，即使gpu空间绰绰有余

same issue, the vllm cannot run multi models on a single gpu even with the setting of gpu-memory-utilization