sglang icon indicating copy to clipboard operation
sglang copied to clipboard

Published 20 hours ago • verified publisher icon sgl-project

Customizing Sampling Behavior

Open Ja1Zhou opened this issue 1 year ago • 0 comments

Hi, is there an interface to specify logits processors as in vLLM?

If possible, could you specify how we can customize the sampling behavior during generation?

Ja1Zhou avatar Jan 24 '24 00:01 Ja1Zhou