private-gpt icon indicating copy to clipboard operation
private-gpt copied to clipboard

Published 20 hours ago • verified publisher icon zylon-ai

Improvement of query response time with GPU

Open sarabconsulting opened this issue 2 years ago • 1 comments

Post ingestion, the response time to queries is very slow as it defaults to CPU. If a GPU is present, shouldn't same automatically use the GPU?

sarabconsulting avatar May 19 '23 05:05 sarabconsulting

Follow https://github.com/imartinez/privateGPT/discussions/217 for GPU discussions

0xraks avatar May 19 '23 11:05 0xraks