Kevin Wang

Results 4 comments of


                                            Kevin Wang

Very slow cold starts even with flashboot

Hello is this being addressed?

[Bug]: Extra Characters in `content` When Using `enable_reasoning` with `stop` Parameter

I can confirm this, it appears only in streaming mode. Mine was extra `think>` randomly appears.

[Bug]: Extra Characters in `content` When Using `enable_reasoning` with `stop` Parameter

> > I can confirm this, it appears only in streaming mode. > > Mine was extra `think>` randomly appears. > > Do you know the cause of this issue?...

[Bug]: stop_sequences is applied to both reasoning_content and content

> It will be resolved in [#14550](https://github.com/vllm-project/vllm/pull/14550) Is this patch available in v0.8.0?