Philippe Lelièvre
Philippe Lelièvre
**Describe the bug** Hi! Using Unreal Engine and having a blueprint window (this could be considered as a popup window?) opened (the engine and the blue print window side by...
In our setup, vLLM's structured generation became 2x slower from 0.5.2 to 0.5.3. The regression was introduced with this [commit](https://github.com/vllm-project/vllm/commit/185ad31f37541ac205b55f446bfd71542f83075). I replaced the LRUCache annotation on the _get_guide function of...
When using vllm and outlines, in our use cases, it seems that the diskcache functionality is not working. Every time the server is started, it doesn't seem to be able...
### Describe the issue as clearly as possible: When using vllm and outlines, when running it from a VM, it seems that the diskcache functionality is not working correctly. Every...