sglang icon indicating copy to clipboard operation
sglang copied to clipboard

Beam Search Support

Open LiquidGunay opened this issue 1 year ago • 0 comments

There was support for a num_beams parameter before but now the sampling parameters has no such parameter. Can support for beam search be restored?

LiquidGunay avatar Apr 08 '24 06:04 LiquidGunay