Hao Zhang
Hao Zhang
@vinlnx could you rebase master and see if it works still well?
@vinlnx I'm fixing some issue in this PR and will merge it once I'm done
@vinlnx Thanks! Now the website can support beam search or return multiple sequence results. One caveat is that when setting num_return_sequence to a bigger value we might have OOM.
@roblox34 thanks for reporting issues -- could you tell us what is your prompt?
@roblox34 You can try to extend the prompt to give it an example translation
@roblox34 I don't think OPT-175B is able to do such an open-ended translation from English to Japanese. You can try to tune your prompt a bit to give a longer...
Thank you. I'll try to finish reviewing this one by Thursday
@jmouchnino Thanks for reporting! Fixing it now!
@jmouchnino fixed.
@YLJALDC please address the comments above?