Foundry-Local
Foundry-Local copied to clipboard
Model auto selection
When it determines whether to download the CPU or GPU version, it should check to see if the GPU memory will support the full model and, if not, downgrade to the CPU verison. Some laptops only have 4G VRAM. Trying to run the GPU version performs poorly with limited VRAM. The CPU version runs with better performance. So, I end up having to manually install the CPU models because the GPU models are nearly useless.
Tagging @MaanavD for visibility.