aibrix icon indicating copy to clipboard operation
aibrix copied to clipboard
verified publisher icon vllm-project

Improve cache awareness for mock app

Open happyandslow opened this issue 9 months ago • 1 comments

Pull Request Description

This branch enhance cache awareness for aibrix mock inference app.

happyandslow avatar Mar 18 '25 20:03 happyandslow

@happyandslow Plz sign the commit, and re-push it to make CI happy

Xunzhuo avatar Mar 19 '25 09:03 Xunzhuo

@happyandslow If you’d still like to move forward with this PR, could you please address the reviewer’s comments?

Jeffwan avatar Jul 24 '25 15:07 Jeffwan