Jiaxin Shan

Support Lora prometheus metrics

3

FIX https://github.com/vllm-project/vllm/issues/11091, part of #6275 Summaries - Extend `log` interface to accept new argument `custom_labels`. - Add `_merge_labels` and `use_labels` context manager. - Move metric logging logic under `with self.use_labels(custom_labels):`....

v0.3.0 roadmap

9

### 🚀 Feature Description and Motivation I create this issue to track the v0.3.0 items we like to work on. We actually have a milestone https://github.com/aibrix/aibrix/milestone/9 to track all issues...

[RFC] Add model API as the umbrella for model centric deployment

3

### 🚀 Feature Description and Motivation As we discussed offline, we consider to provide a Model API object, designed to simplify and unify the deployment of models by managing all...

Enable `apply` to replace `create` in manifest deployment

8

### 🚀 Feature Description and Motivation create is very tricky and not good for version upgrade. We get chance to lose the fixed ip. Let's see if there's any options...

Research & Industry Collaboration Invitation

4

### 🚀 Feature Description and Motivation We're looking for contributors and collaborators to join efforts in pushing forward AI infrastructure research and industry adoption. If you're interested in LLM infrastructure,...

Run small models with vLLM CPU mode for local development testing

1

### 🚀 Feature Description and Motivation We already have mocked app for most feature integration testing, however, this is still not that convenient in some cases. We should check whether...

### 🐛 Describe the bug ``` I0214 00:36:27.428639 1 gateway.go:219] "-- In RequestHeaders processing ..." requestID="38630cf2-358f-4401-b663-9e9271082dd1" I0214 00:36:27.428828 1 gateway.go:284] "-- In RequestBody processing ..." requestID="38630cf2-358f-4401-b663-9e9271082dd1" I0214 00:36:27.428855 1 gateway.go:355]...

Expose gateway error message to external

2

### 🐛 Describe the bug  We need to expose such error message to external users. ### Steps to Reproduce _No response_ ### Expected behavior _No response_ ### Environment _No...

Prepare for the aibrix open source

3

### 🐛 Describe the bug There're few things need to be polished before open source. - [x] blog post website https://aibrix.github.io/ - [x] blog post on the v0.1.0 & v0.2.0...

v0.2.0-rc.2 failed to pin container images

1

### 🚀 Feature Description and Motivation 1. controller-manager   2. gateway-plugins version is incorrect  3. gpu-optimizer  ### Use Case _No response_ ### Proposed Solution _No response_