Hongbo Zhang

icon indicating a website link hongbozhang.site

icon location Hangzhou icon location PhD student at Westlake University, WestlakeNLP.

Results 2 issues of Hongbo Zhang

[Bug] Wrong tokens with mistral model

5 comment

### Checklist - [X] 1. I have searched related issues but cannot get the expected help. - [X] 2. The bug has not been fixed in the latest version. -...

[Feature] Does sglang now support beam search

2 comment

### Motivation Does sglang now support beam search? I tried using the 'best_of' parameter, but the output seems to be the same as if it wasn't used. ### Related resources...