Jiaxin Shan

  looks like worker node has enough resoures

 I can not easily figure this out. Kind of hard to debug the kind problem here.

look at this issue and notice the default CPU & Memory are wrong, it all use value 2 instead of 2Gi. Update the kubebuilder default value


@brosoul v0.1.0 or v0.2.0?

I move to v0.2.0 for now. Let's concentrate more on the stability of the entire solution and then come back to such feature.

@varungup90 I did make above change but seems it's not working. your scripts is exact same as the one I attached in the issue, right? --- Just notice your test...

@varungup90 did your test against the deepseek model? I used latest release-0.2 version and the problem still exist and I tried both httpRoute and custom strategy.  ``` INFO 03-09...

Varun found it's more like data issue. I change from random to shareGPT dataset `--dataset-name sharegpt --dataset-path /Users/bytedance/Downloads/ShareGPT_V3_unfiltered_cleaned_split.json` > Note: `--dataset-name sonnet --dataset-path /Users/bytedance/workspace/vllm/benchmarks/sonnet.txt` works as well dataset is here...

Have a short sync up with @varungup90 I mean pod Running, but ready. Pod will only be ready after all containers are ready.