lmdeploy icon indicating copy to clipboard operation
lmdeploy copied to clipboard

doc: add example of deploying api server to Kubernetes

Open uzuku opened this issue 10 months ago • 2 comments

Modification

Doc: add example of deploying api server to Kubernetes.

uzuku avatar Apr 24 '24 11:04 uzuku

Basically, I agree with @zhyncs but how about making k8s folder in the root directory? The config content mentioned can be put in a yaml under that folder. And the api_server user guide can refer to this yaml as an example

lvhan028 avatar Apr 25 '24 02:04 lvhan028

@lvhan028 @zhyncs I've put the related yaml files under the k8s folder in the root directory.

uzuku avatar Apr 29 '24 13:04 uzuku

pls fix the linting error

pip install pre-commit
cd the/root/path/of/lmdeploy
pre-commit install .
pre-commit run --all-files

lvhan028 avatar May 03 '24 02:05 lvhan028

pls fix the linting error

@lvhan028 fixed

uzuku avatar May 06 '24 05:05 uzuku

Basically, I agree with @zhyncs but how about making k8s folder in the root directory? The config content mentioned can be put in a yaml under that folder. And the api_server user guide can refer to this yaml as an example

The api_server folder under k8s may mislead to kubernetes' own api server, how about rename the yaml's folder to k8s/example?

flyhighzy avatar May 06 '24 06:05 flyhighzy