WizardLM
WizardLM copied to clipboard
Wizard Math 7B cann't stop generate
when I use Wizard Math 7B generate, it can't stop, and out out </s>
which is same to eos token, and I print the output tensor in torch , I find the </s>
is be split to three token, </
,s
,>
, which is not eos token,
but when I use the Wizard 13B, it works , I think there may be err in Wizard Math 7B SFT
Thank you for your interest in our work. Maybe you should to manually set the stop_tokens = ['</s>'] like our WizardMath demo
Thank you for your interest in our work. Maybe you should to manually set the stop_tokens = [''] like our WizardMath demo
Thanks