Brandon T. Willard
Results
522
comments of
Brandon T. Willard
The source of this issue appears to be [`vllm`'s use of `outlines.cache`](https://github.com/vllm-project/vllm/blob/551ce01078a655068e5ec3764d0a55ac744ea425/vllm/model_executor/guided_decoding/outlines_logits_processors.py#L91) on functions that are ultimately used as class methods. Those functions include the class type instances in their...
It doesn't look like the ordering is taking effect in CI, but it does locally.