Superskyyy
Same issue, on a laptop with touch screen this happens
This would be a killer feature.
I have implemented a solution for non streaming, will open a draft PR over the weekend after some more testing. Still need to do changes for the streaming version.
I suggest using Nanobind, nanobind is the next generation of pybind11 from the same guy that invented it. It is suggested officially to use nanobind over Pybind11. Python 3.8+ is...
同求，文件上传能力对很多场景很有用，比如代码分析，文档上传这些。
@shuaills Seeing the exact same issue, any tool call will fail on qwen25 model (I'm using Qwen2.5-72B-Instruct, apparently deepseek model have the same problem). Can someone help look into this?...
> I'm also seeing this in my PR [#2798](https://github.com/sgl-project/sglang/pull/2798), when the input is `None`? > > Are you also calling tools? @Edenzzzz
I can confirm that changing to an empty string works as a workaround.
> So we should PR to make it convert None to an empty string? I think so, it can avoid unexpected complications.
@wonderhelios 你好 我们也对性能很感兴趣,请问可以分享出来测试用的代码吗 我这也想跑一下