aibrix
aibrix copied to clipboard
Integrate the benchmark code into CI Job
🚀 Feature Description and Motivation
We've seen many issues related to benchmark
- https://github.com/vllm-project/aibrix/issues/1040
- https://github.com/vllm-project/aibrix/issues/1029
- https://github.com/vllm-project/aibrix/issues/1028
Can we integrate the code to CI system to make sure the code can run successfully? This at least give some confidence.
We can start with sample app and here's an example https://github.com/vllm-project/aibrix/blob/main/.github/workflows/installation-tests.yml
Use Case
Improve the benchmark quality
Proposed Solution
No response