geminizyz

Results 2 issues of geminizyz

### 是否已有关于该错误的issue或讨论? | Is there an existing issue / discussion for this? - [X] 我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions ### 该问题是否在FAQ中有解答? | Is there an...

请问跑minicpm-llama3-v-2_5(int4)支持并发调用接口么?2个及以上并发调用就报错了,单个没有问题。。。。 ![微信截图_20240619180246](https://github.com/xorbitsai/inference/assets/167763677/caba7bf3-199d-4a24-88a3-b0e9833b50b2) ![微信截图_20240619180359](https://github.com/xorbitsai/inference/assets/167763677/a91e48c4-c31e-48b9-917b-303ceb67cef1) 需要怎么样才能并发呢?目前是一台物理机 24G 显卡,虽然资源不多,但希望能够实现起码2个并发吧~~

question