vllm icon indicating copy to clipboard operation
vllm copied to clipboard

[Bugfix] Fix async log stats

Open alexm-redhat opened this issue 5 months ago • 5 comments

This PR fixes the issue described here: https://github.com/vllm-project/vllm/issues/8219#issuecomment-2345021537

The fix is simple, we need to skip log stats for sequences that are already preempted since their state is reset to PREFILL (for recompute).

alexm-redhat avatar Sep 12 '24 13:09 alexm-redhat