vllm icon indicating copy to clipboard operation
vllm copied to clipboard

[Usage]: how to shutdown vllm server

Open wiluen opened this issue 5 months ago • 1 comments

Your current environment

The output of `python collect_env.py`

How would you like to use vllm

if i use

vllm serve llm/qwen/Qwen2-0.5B-Instruct

how to shutdown vllm server use command?

Before submitting a new issue...

  • [X] Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

wiluen avatar Sep 11 '24 06:09 wiluen