Jiaxin Shan
Jiaxin Shan
apologies for late response. I was busy with some events recently and I will finish review by EOD.
/cc @gemini-code-assist
@Venkat2811 seems this one have some conflicts with main branch. could you rebase the main and resolve it. The change looks good to me
@Venkat2811 I tried to merge this morning but notice it has conflict with upstream. could you help resolve it? (Looks like my earlier comment didn’t go through) 
@Venkat2811 I see you already cut https://github.com/vllm-project/aibrix/pull/1222 , we can move to #1222. Once the integrate test pass, I will merge it and we can close this one
but how can use deploy it.. the workflow is so complicated to end users
thanks for driving this effort. @Belyenochi I just assign this issue to you
@Belyenochi Great start! I love this rough design. Here’s how I’d evaluate and shape predictive autoscaling for LLM workloads in AIBrix. - I think both the Netflix and Google philosophies...
@igor-susic1 yes. @Belyenochi get some errands recently, we'd like to ship this feature as fast as we can
@mareksimunek I just replied. thanks for the feedback!