Jiaxin Shan

P/D orchestration and routing is supported. we can close this issue now. v0.4.0 will expose more samples and documentation

/cc @zhangjyr could you help take a look at this issue?>

container inside files ``` drwxr-xr-x 3 root root 16384 Mar 9 00:08 . drwxr-xr-x 3 root root 4096 Mar 8 23:52 .. drwxr-xr-x 3 root root 4096 Mar 8 23:52...

I initially use following configuration but https://huggingface.co/deepseek-ai/DeepSeek-R1/tree/main has a important files named `configuration_deepseek.py`, ``` - name: DOWNLOADER_ALLOW_FILE_SUFFIX value: json, safetensors ```  change the value to `json, safetensors, py` resolves...

@ying2025 which kuberay version are you using?

1. Did you add `block: 'false'` in the `rayStartParams`? this is required to remove the `--block` in startup command 2. Underneath operator kuberay has a bug on disabling `--block` and...

@ying2025 thanks for the confirmation

@ying2025 Yeah, it will be part of kuberay. I am asking one engineer to help with it. here's the code branch https://github.com/ray-project/kuberay/commit/91e1c26fbf1fc0f505ff7d16b70cf8228ed62ec4#diff-cc9abb27aaceca3f10193e2ab35fb00dca44b8858709c5c0f4df751c1387291aR576 and original issue https://github.com/vllm-project/aibrix/issues/245#issuecomment-2394811082

@vivekrsintc Thanks for reporting the issue. We've fixed a few issues and now it exposes the accurate messages. I think only one case now will return such error which is...

@MohamedHAlzhrani could you try v0.3.0 instead? This issue has been resolved.