gpt4all
gpt4all copied to clipboard
recomennded hardware for GPU inference
I want to buy the nessecary hardware to load and run this model on a GPU through python at ideally about 5 tokens per second or more. What GPU, ram, and CPU do you recommend? (I want to make an API for personal use) My budget is about 1000€