Zijie Chen

Results 4 comments of Zijie Chen

请问,如果我有多个线程同时调用一个lmdeploy的internvl2服务(message不一样),前面说的设置完server是自动并发处理还是需要我把所有message整合起来作为一个batch一起调用才能并发?

Thanks. I'm looking forward to it!

Will simply putting all images in "image" work for my case?

Thanks, I've already solved my issue. Sorry not closing the issue in time