rwkv.cpp icon indicating copy to clipboard operation
rwkv.cpp copied to clipboard

Published 20 hours ago • verified publisher icon RWKV

how to use offload and threads

Open guoguo1314 opened this issue 5 months ago • 0 comments

Hello, if I want to use NVIDIA GPU acceleration for specific layers in the network and run rwkv.cpp with a specified number of threads, how should I run the program? Or what command should I use?thank you.

guoguo1314 avatar Sep 02 '24 07:09 guoguo1314