vllm icon indicating copy to clipboard operation
vllm copied to clipboard
verified publisher icon vllm-project

v0.6.1.post1 Release Tracker

Open simon-mo opened this issue 1 year ago • 5 comments

Anything you want to discuss about vllm.

  • [x] #8390
  • [x] #8375
  • [x] #8399
  • [ ] #8417
  • [x] #8415
  • [x] #8376
  • [x] #8425

simon-mo avatar Sep 12 '24 17:09 simon-mo

#8425

ywang96 avatar Sep 12 '24 17:09 ywang96

Perhaps we can add the flashinfer+multi-step backend PR https://github.com/vllm-project/vllm/pull/7928

SolitaryThinker avatar Sep 12 '24 18:09 SolitaryThinker

#8428 not a real release blocker, but could help with main branch CI

ywang96 avatar Sep 12 '24 22:09 ywang96

Should add this PR that fixed cudagraph+multistep https://github.com/vllm-project/vllm/pull/8340.

SolitaryThinker avatar Sep 12 '24 23:09 SolitaryThinker

https://github.com/vllm-project/vllm/pull/8354

SolitaryThinker avatar Sep 13 '24 00:09 SolitaryThinker

Done https://github.com/vllm-project/vllm/releases/tag/v0.6.1.post1

simon-mo avatar Sep 13 '24 05:09 simon-mo