MiniCPM-V icon indicating copy to clipboard operation
MiniCPM-V copied to clipboard

Published 20 hours ago • verified publisher icon OpenBMB

流式输出

Open sssssshf opened this issue 1 year ago • 0 comments

请问在git主页的测试案例,如何实现模型的流式输出呢? 或者huggingface主页的推理示例如何实现流式输出,一个字一个字的输出 而非一句话一起输出

sssssshf avatar Apr 24 '24 02:04 sssssshf