llama2-webui
llama2-webui copied to clipboard
Why can llama understand Chinese so much and can't reply directly in Chinese?
Why can't llama understand Chinese so much and can't reply directly in Chinese?
I tested Llama-2-7b-chat-hf again today.
Test using GPU platform: matpool.com Memory usage: Open 8BIT occupies 8G+, GPU utilization: 13-20% If 8BIT is not enabled, it takes up 14G+, GPU utilization: 55-70%