yilun wang（王逸伦）

waht' is the rule of autoscaler

1

## Environment details: * local deployment, native ubuntu, Mac OS, Kubernetes, ... * version of docker, ubuntu, ... ## Steps to reproduce the issue: 1. 2. 3. ## Provide the...

Is there some function examples?

1

hi,s8sg, do you already provide some functions,i want to try it!

[Usage]: how to shutdown vllm server

1

### Your current environment ```text The output of `python collect_env.py` ``` ### How would you like to use vllm if i use > vllm serve llm/qwen/Qwen2-0.5B-Instruct how to shutdown vllm...

How to get attention scores

1

Does your codes have function to analyze attention scores, or needs to be observed in the **Transformer** class