llama2-webui icon indicating copy to clipboard operation
llama2-webui copied to clipboard

Why can llama understand Chinese so much and can't reply directly in Chinese?

Open XksA-me opened this issue 1 year ago • 4 comments

Why can't llama understand Chinese so much and can't reply directly in Chinese?

I tested Llama-2-7b-chat-hf again today.

Test using GPU platform: matpool.com Memory usage: Open 8BIT occupies 8G+, GPU utilization: 13-20% If 8BIT is not enabled, it takes up 14G+, GPU utilization: 55-70%

image image image

XksA-me avatar Jul 27 '23 07:07 XksA-me