vllm
vllm copied to clipboard
[Bugfix] Fix async log stats
This PR fixes the issue described here: https://github.com/vllm-project/vllm/issues/8219#issuecomment-2345021537
The fix is simple, we need to skip log stats for sequences that are already preempted since their state is reset to PREFILL (for recompute).