zhanglzu
zhanglzu
I got the same question. After I update nividia driver from 10.2 to 11.7, and everything be fine. I have no idear about what is happening. ps :centos 7.6 and...
I also Got a Qustion. Since I have two V100s, if i use the first one (--device cuda:0), and it got work. But if I use the second one (--devise...
使用本地部署的qwq-32b，遇到同样的问题；但是用deepseek-v3这种非reason模型，就输出正常。是不是所有reason模型都有这种问题？
> > 使用本地部署的qwq-32b，遇到同样的问题；但是用deepseek-v3这种非reason模型，就输出正常。是不是所有reason模型都有这种问题？ > > 这种属于非html标签，所以渲染异常吧 感谢回复！感谢作者开源自己的项目！请问是否可以通过更改prompt，来改善这种现象。
我怀疑是：reason模型，尤其是qwq-32b，强制出现"\"字符,导致html渲染错误。 但是无论我怎么修改prompt，都无法禁止"\"的出现。
> also depends a lot on the model and its size ofcourse, but with the reporter.md you should be able to instruct it on how you want your message formatted...