[Usage]: Collect performance metrics in offline serving

[nsantavas]

Your current environment

.

How would you like to use vllm

I want to collect the performance metrics in an offline serving setting. Is it possible? and if yes how?

Thanks!

Before submitting a new issue...

• [X] Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.