llama2-webui icon indicating copy to clipboard operation
llama2-webui copied to clipboard

Published 20 hours ago • verified publisher icon liltom-eth

Test log | Welcome to communicate

Open XksA-me opened this issue 1 year ago • 6 comments

# test log

Cloud platform: matpool.com Machine used: NVIDIA A40 Model used: Llama-2-13b-chat-hf After the model is loaded, it takes up video memory: about 26G Inference memory usage: about 26G GPU utilization: about 80% image Memory usage: about 2G image

If hhhh cannot be written, it will also be filled with characters image

XksA-me avatar Jul 26 '23 05:07 XksA-me