llama icon indicating copy to clipboard operation
llama copied to clipboard

Published 20 hours ago • verified publisher icon meta-llama

Does it support Chinese?

Open terrifyzhao opened this issue 2 years ago • 5 comments

terrifyzhao avatar Feb 27 '23 04:02 terrifyzhao

i have same question

AISuperMa avatar Mar 02 '23 06:03 AISuperMa

i have the same question too， in llama paper i could not find any zh corpus

qwer10 avatar Mar 02 '23 07:03 qwer10

I have tested the Chinese support with the 7B model. Unfortunately, it seems the support of Chinese is extremely poor. (Perhaps increase the parameters can improve the performance in Chinese, but I have no ability to test)

mnixry avatar Mar 02 '23 12:03 mnixry

I have tested the Chinese support with the 7B model. Unfortunately, it seems the support of Chinese is extremely poor. (Perhaps increase the parameters can improve the performance in Chinese, but I have no ability to test)

I think if the vocab contains chinese character, it is fine, we can fine-tuning it, but if it doesn't, it is hard to us to do more research in chinese

AISuperMa avatar Mar 07 '23 08:03 AISuperMa

Hi, i have tried to fine-tune LLaMA model for better Chinese text generation. Please refer to: https://github.com/feizc/MLE-LLaMA

feizc avatar Mar 21 '23 05:03 feizc

Closing this issues - Cool project @feizc !!

jspisak avatar Sep 06 '23 04:09 jspisak