gemma.cpp icon indicating copy to clipboard operation
gemma.cpp copied to clipboard

The application does not use Nvidia GPU in WSL

Open dannyvpm opened this issue 1 year ago • 1 comments

While running the Gemma C++ app using the 7B model in my WSL, the Nvidia GPU usage is at 0% though I have CUDA toolkit installed and also the WSL instance recognizes the GPU.

dannyvpm avatar Feb 24 '24 09:02 dannyvpm

Right, please see #18 :)

jan-wassenberg avatar Feb 25 '24 06:02 jan-wassenberg

Closing for now, but yes track https://github.com/google/gemma.cpp/issues/18 will add some additional info in the README as well.

austinvhuang avatar Feb 26 '24 15:02 austinvhuang