WizardLM icon indicating copy to clipboard operation
WizardLM copied to clipboard

Wizard Math 7B cann't stop generate

Open Fazziekey opened this issue 1 year ago • 2 comments

image

when I use Wizard Math 7B generate, it can't stop, and out out </s> which is same to eos token, and I print the output tensor in torch , I find the </s> is be split to three token, </,s,>, which is not eos token, but when I use the Wizard 13B, it works , I think there may be err in Wizard Math 7B SFT

Fazziekey avatar Aug 31 '23 07:08 Fazziekey

Thank you for your interest in our work. Maybe you should to manually set the stop_tokens = ['</s>'] like our WizardMath demo

flyinghpluo avatar Sep 01 '23 03:09 flyinghpluo

Thank you for your interest in our work. Maybe you should to manually set the stop_tokens = [''] like our WizardMath demo

Thanks

Fazziekey avatar Sep 01 '23 03:09 Fazziekey