Qwen2.5 icon indicating copy to clipboard operation
Qwen2.5 copied to clipboard

Published 20 hours ago • verified publisher icon QwenLM

how to batch inference?

Open xyw7 opened this issue 10 months ago • 1 comments

请问如何批量推理呢

xyw7 avatar Apr 08 '24 07:04 xyw7

https://qwen.readthedocs.io/zh-cn/latest/inference/chat.html check this doc. your model input can be a list of text

JustinLin610 avatar Apr 09 '24 15:04 JustinLin610