Foundry-Local icon indicating copy to clipboard operation
Foundry-Local copied to clipboard

Model auto selection

Open chuckbeasley opened this issue 5 months ago • 1 comments

When it determines whether to download the CPU or GPU version, it should check to see if the GPU memory will support the full model and, if not, downgrade to the CPU verison. Some laptops only have 4G VRAM. Trying to run the GPU version performs poorly with limited VRAM. The CPU version runs with better performance. So, I end up having to manually install the CPU models because the GPU models are nearly useless.

chuckbeasley avatar Jul 14 '25 17:07 chuckbeasley

Tagging @MaanavD for visibility.

chuckbeasley avatar Jul 14 '25 17:07 chuckbeasley