FastChat icon indicating copy to clipboard operation
FastChat copied to clipboard

Published 20 hours ago • verified publisher icon lm-sys

Can support the new model about Llama3

Open 1737686924 opened this issue 1 year ago • 7 comments

Can support the new model about Llama3

1737686924 avatar Apr 19 '24 06:04 1737686924

+1 here. Especially the chat template

namespace-Pt avatar Apr 19 '24 06:04 namespace-Pt

Guys, is it the same as llama2?

March-7 avatar Apr 19 '24 08:04 March-7

伙计们，它和 llama2 一样吗？

I have not tested it myself, but I saw the evaluation results on meta, which are better and more advanced than llama2, and I heard that the open source Llama for 400B is being prepared, which should be better than GPT4

1737686924 avatar Apr 19 '24 08:04 1737686924

+1

They are 3 pending pull request #3257 #3256 #3259

sohelzerdoumi avatar Apr 19 '24 10:04 sohelzerdoumi

Guys, when will the conversation template for new models like llama3 be updated to main？

March-7 avatar Apr 20 '24 11:04 March-7

Change the file tokenizer_config.json: eos_token: end_of_text ==> eot_id

it work!

hongyinjie avatar Apr 22 '24 12:04 hongyinjie

@hongyinjie What change are you referring to? does this can fix llama3 can't stop problem? https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct/discussions/4

Oscarjia avatar Apr 23 '24 12:04 Oscarjia