vllm
vllm copied to clipboard
[Feature]: Implement `check_health` for V1
🚀 The feature, motivation and pitch
Currently check_health is a no-op in V1. We should have an explicit way to check if the engine is still alive and all the subprocesses are healthy. This will enable better functionality in an operational system
Alternatives
No response
Additional context
No response
Before submitting a new issue...
- [x] Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.
Please assign this to me, I’m very interested in solving this issue!
I noticed this issue is still open. I’d love to contribute as well. Happy to collaborate if you're open to it, or take it on if it's available. Let me know!
If the issue is still open, would take it up.