fastllm icon indicating copy to clipboard operation
fastllm copied to clipboard

How to specify the GPU serial number?

Open LanShanPi opened this issue 1 year ago • 0 comments

I currently have multiple graphics cards, and I want to have a model on each card. If so, I need to place the model on the specified graphics card. So, how should I specify the graphics card when using your acceleration method? I didn't see any relevant information in your README.

LanShanPi avatar Jul 11 '23 13:07 LanShanPi