private-gpt icon indicating copy to clipboard operation
private-gpt copied to clipboard

Published 20 hours ago • verified publisher icon zylon-ai

What are the minimum hardware requirements ?

Open wakuwakuuu opened this issue 2 years ago • 2 comments
trafficstars

I would like to know how much memory is needed? And whether it can run on the CPU?

wakuwakuuu avatar May 18 '23 07:05 wakuwakuuu

image It's using about 14GB on mine when answering questions. It was lower when I was ingesting dataset I'm using 24GB memory with AMD Ryzen 7

0xraks avatar May 18 '23 10:05 0xraks

image It's using about 14GB on mine when answering questions. It was lower when I was ingesting dataset I'm using 24GB memory with AMD Ryzen 7

Could you advise how long it takes to answer prompts?

Also, how long does it take to fine tune with some local documents? Thanks.

vinhdizzo avatar May 23 '23 19:05 vinhdizzo

It is necessary to have a specific video card?

HansLanger avatar Nov 10 '23 00:11 HansLanger