yuyu
Results
3
comments of
yuyu
> > Roughly did the same thing. I just let all oov logits be -inf in the sampler file of vllm engine. > > Could you please offer some hints...