0xWe11es.eth

Guidance provides better primitives such as `zero_or_more` and `one_or_more`, so will sgl supports such primitives like this: https://github.com/guidance-ai/guidance/discussions/402#discussioncomment-7863261

> The primitive `zero_or_more` is more like a syntax sugar. We now only support constraint decoding with raw regex format; the higher-level primitives may be supported in the future, not...

I encounter the same problem when I test `test/srt/model/test_llama_low_api.py`. I use `python test_llama_low_api.py` and then it crashes with the same output. The error happens in the `Prefill` function.

不好意思，回复晚了，请问您是指文档需要增补一些中文论坛相关的内容？还是说希望我们建立一个中文论坛来讨论这个知识库相关的内容 :joy: