mini-sglang icon indicating copy to clipboard operation
mini-sglang copied to clipboard
Published 1 day ago • verified publisher icon sgl-project

feat: Implement request cancellation

Open Zaire404 opened this issue 1 week ago • 0 comments

Description

This PR implements a complete request cancellation mechanism to prevent GPU resource waste when clients disconnect. It addresses the issue described in #[15].

Verification

before image

after image

fix #15

Zaire404 avatar Dec 18 '25 14:12 Zaire404