junyan-zg
Results
1
issues of
junyan-zg
I had 8 * 4090，I want to put the 7 cards on gpu_layers，the KV cache for the free card，how to set？Now the KV on the cpu load is so slowly.