jinhuck comments

Repositories
Issues
Comments

Results 2 comments of


                                            jinhuck

WebAPI project isn't using GPU, even though CUDA backend gets loaded by LlamaSharp.dll

The same problem. LLAMA.WEB is not currently utilizing CUDA.

WebAPI project isn't using GPU, even though CUDA backend gets loaded by LlamaSharp.dll

The 0.8.0 version is utilizing CUDA and showing stable performance. 0.8.0 is very solid version!! +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ $ dotnet run [LLamaSharp Native] [Info] Detected OS Platform: WINDOWS [LLamaSharp Native] [Info] Detected...