private-gpt icon indicating copy to clipboard operation
private-gpt copied to clipboard

Published 20 hours ago • verified publisher icon zylon-ai

Not understandable responses with n_gpu_layers

Open jonyeecoder opened this issue 1 year ago • 1 comments

i was able to get proper understandable english responses in its original state after enabling privategpt with gpu acceleration, i got response that was not understandable in english when using n_gpu_layers

anyhow encountered this issue before? will be great to know the solution

Thanks.

jonyeecoder avatar Jun 10 '23 04:06 jonyeecoder

I could try to replicate your issue and explore possible solutions. How did you implement the use of GPU?

SH1436 avatar Jun 13 '23 20:06 SH1436