aibrix icon indicating copy to clipboard operation
aibrix copied to clipboard
verified publisher icon vllm-project

batch api further improvements tracking issue

Open Jeffwan opened this issue 2 months ago • 3 comments

🐛 Describe the bug

there're few issues after reviewing and testing the latest batch API.

Steps to Reproduce

listed above

Expected behavior

N/A

Environment

nightly

Jeffwan avatar Oct 10 '25 21:10 Jeffwan

We need to fix these issues in v0.5.0

Jeffwan avatar Oct 25 '25 07:10 Jeffwan

Image

https://github.com/vllm-project/aibrix/pull/1698#discussion_r2462650519

good suggestion

Jeffwan avatar Oct 25 '25 07:10 Jeffwan

Image

https://github.com/vllm-project/aibrix/pull/1700#discussion_r2462669774

Jeffwan avatar Oct 25 '25 08:10 Jeffwan