mlc-llm icon indicating copy to clipboard operation
mlc-llm copied to clipboard

Published 20 hours ago • verified publisher icon mlc-ai

mlc_chat_cli doesn't using GPU

Open NeoWang9999 opened this issue 2 years ago • 1 comments

mlc_ chat_ Cli is running on my WSL, but it seems that I didn't use GPU, but instead used CPU entirely, which is very slow. How can I use GPU in this environment?

image

image

NeoWang9999 avatar May 18 '23 03:05 NeoWang9999

If the Vulkan driver is not properly installed, the CPU simulation of Vulkan will be used, the way to check out the vulkan installation is find if the /usr/share/vulkan/icd.d/nvidia_icd.json exists.

LeiWang1999 avatar May 20 '23 05:05 LeiWang1999