aibrix icon indicating copy to clipboard operation
aibrix copied to clipboard
verified publisher icon vllm-project

Polish benchmark scripts for autoscaling and routing

Open Jeffwan opened this issue 10 months ago • 0 comments

🚀 Feature Description and Motivation

We have some initial work here. https://github.com/aibrix/aibrix/tree/main/benchmarks in v0.1.0 testing. however, these scripts are not polished very well. Since we did lots of testing in downstream, it's time to push our benchmark codes to upstream.

Let's focusing on autoscaling and routing in this story.

Use Case

No response

Proposed Solution

No response

Jeffwan avatar Feb 11 '25 04:02 Jeffwan