Which trained model to choose for GPU-12GB, Ryzen 5500, 64GB?

[blackcement]

Which trained model to choose for GPU-12GB, Ryzen 5500, 64GB? to run on the GPU. Please give a direct link

[yhyu13]

@blackcement It only requires about 5G of ram to run on CPU only with the gpt4all-lora-quantized.bin model available here https://the-eye.eu/public/AI/models/nomic-ai/gpt4all/gpt4all-lora-quantized.bin, and it gives a decent 2 tokens/sec on my AMD 7002 workstation

[blackcement]

@yhyu13 No, I'm asking about GPU usage, I have NVIDIA GeForce RTX 3060 12GB

[niansa]

Stale, please open a new, updated issue if this is still relevant.