Richard Liu

The risk of moving test framework code into kubeflow/testing is that if it breaks, all presubmit tests in all repos also break. Fixing the test framework also requires a PR...

I am able to verify that this works if I use the benchmark script. I also verified it on Ray Serve. Why is the behavior different if I send the...

@juncgu This would need nixl to be installed in the dockerfile. Should we add that to https://github.com/vllm-project/vllm/blob/main/requirements/tpu.txt?

I think this should be fixed now (https://github.com/richardsliu/ray-on-gke/pull/3)

Moved to 0.6.0

This is unlikely to happen in 0.6. The user experience should be improved with the new UI, so this can be lower in priority. @johnugeorge @gaocegege @YujiOshima FYI