Liangsheng Yin

@lyingqi `HEAP_SPACE_SIZE` 是由`config.rs`中的常数`KERNEL_HEAP_SIZE = 0x30_0000`决定的

I came across this problem too. When the downloading link is with `server-linux-x64`, it goes well. ``` wget https://update.code.visualstudio.com/commit:863d2581ecda6849923a2118d93a088b0745d9d6/server-linux-x64/stable ``` But on my AWS remote machine, the download link is...

@HoqueMahmudul We only support huggingface format to load model weights. I am not sure what is your checkpoint's format, you can figure out how to convert it to huggingface format.

Of course, you can. Just specify the regex of the json list. Here is a simple example code: ```python from sglang import function, gen, set_default_backend, Runtime JSON_ITEM_REGEX = r"{\"name\": \"\w+\",...

However, letting LLM control the generated number of JSON items may be unreliable. By calling `sgl.gen()` with only the JSON item regex multiple times, you can decode whatever number you...

The primitive `zero_or_more` is more like a syntax sugar. We now only support constraint decoding with raw regex format; the higher-level primitives may be supported in the future, not only...

Glad to work with you! I tried to import outlines a few weeks ago when your version was 0.0.22. The dependency error is ``` Could not apply nest_asyncio: Can't patch...

By the way, we just implemented simple regex for constraint decoding; later, we also want to support more complex constraint decoding, such as CFGs. I am happy to see you...

@rlouf Hi, I have made `outlines` an import in this PR(#60). But when I set `vllm>=0.2.5` and `outlines>=0.0.24` as dependencies at the same time， we meet a conflict error: ```...

@rlouf Hi, I have imported outlines as a dependency(#168). Thanks for your great work on FSM and regex!