ramyaprabhu-alt

Hi, I'm one of the authors of this paper. Thank you for your interest in our work! We plan to release the code soon, hopefully in a few weeks.

Our initial release will be as a separate project on a slightly older version of vLLM. But soon after, we can also raise a PR against vLLM-latest.

> is this still on VLLM roadmap to integrate? Please let us know. > > Thanks If there is still interest from vLLM community, we will be happy to contribute!