qwen.cpp icon indicating copy to clipboard operation
qwen.cpp copied to clipboard

Published 20 hours ago • verified publisher icon QwenLM

Why does `TextStreamer` hold on punctuation?

Open Wovchena opened this issue 1 year ago • 0 comments

https://github.com/QwenLM/qwen.cpp/blob/86547f160abf6eb4979a6f246f5177565e662ae4/qwen.cpp#L115 TextStreamer waits for the next token before printing punctuation. What's the harm to print it as the last char?

Wovchena avatar Jan 08 '24 15:01 Wovchena