qwes5s5

[Cherry-Pick][Feature]Add a switch for logprobs/prompt_logprobs token decoding.(#5436)

2

## Motivation > :bulb: If this PR is a Cherry Pick, the PR title needs to follow the format by adding the [Cherry-Pick] label at the very beginning and appending...

[Feature] Support stopping the inference for the corresponding request in the online service after a disconnection request.

2

## Motivation > :bulb: If this PR is a Cherry Pick, the PR title needs to follow the format by adding the [Cherry-Pick] label at the very beginning and appending...