Samuel Kemp comments

Repositories
Issues
Comments

Results 24 comments of


                                            Samuel Kemp

[Mac] Model: deepseek-r1-distill-qwen-7b-generic-gpu can't use GPU

This is similar issue to #130 and #134 where we need better handling of the device memory and then pulling the right model. In this case if the GPU memory...

Question: Model that supports function calling

Duplicate of #116 #91 #142

How to select in multi gpus env

Thanks for raising an issue @ZhangWei125521! Currently, we do not expose a mechanism to select an execution provider (CUDA, Intel, AMD) for a given device.

How to select in multi gpus env

This will be part of the WinML work.