vllm-project
customize the kubebuilder cluster file for more granular testing
🚀 Feature Description and Motivation
Currently, we just use kind to provision the cluster and this is too simple. In order to send request to the cluster server etc, we need to expose some endpoints which required more cluster level customization. At the same time, cluster version needed to be specified in the configuration for compatibility purpose.
kind create cluster --name integration-test
Use Case
No response
Proposed Solution
No response
Let's also build the necessary setups to make sure we can test aibrix in kind GPU cluster. Ideally, for anyone with GPU VM node, they should be able to test aibrix easily.
- Use lambda cloud instance
- Follow the guidance here https://github.com/aibrix/aibrix/tree/main/docs/tutorial/distributed
- Instance aibrix package etc, make sure we have ports open for most use cases.
The new platform should be single node ECS machine, this is good for anyone who want to play with it and also works for workshop purpose.
@Jeffwan hi, Jeffwan, https://github.com/aibrix/aibrix/tree/main/docs/tutorial/distributed link is 404, I think should this https://github.com/vllm-project/aibrix/tree/main/development/tutorials/distributed ? about this issue, should according run-e2e-tests.sh to write kind-config.yaml?
