Minimum hardware Requirements to run the models locally?

[joylijoy]

what are the minimum hardware requirements to run the models on a local machine ? thanks Requirements CPU : GPU: Ram:

[umar-mq]

For the 8B in Q8 it is about 9GB RAM minus Your GPU's VRAM For the 70B in Q8 it's about 85GB RAM minus VRAM

If you use smaller quantizations, it should take less space

[ash809]

what are the minimum hardware requirements to run the models on a local machine ? thanks Requirements CPU : GPU: Ram:

it would be required for minimum spec... cpu-i5 10gen or minimum 4core cpu gpu-gtx1660 super and its vram -6gb vram ram-12gb ram and ddr4 frequency its to be 3200mhz.......