GPT4All should display incompatible GPU's in dropdown and disable them

[amichelis]

Issue you'd like to raise.

Asus ROG Notebook Windows11 Intel I7 Nvidia GTX1050ti Driver 531.61 4Gigs ram

Suggestion:

No response

[cosmic-snow]

Alright, first of all: The dropdown doesn't show the GPU in all cases, you first need to select a model that can support GPU in the main window dropdown.

Can you download the Mini Orca (Small), then see if it shows up in this dropdown? That's the 3B version of Mini Orca. Although I'm not sure whether it will be able to load that with 4GB of VRAM. The whole model and some more needs to fit in VRAM for GPU support to work, at least at the moment.

[amichelis]

Same behavior.. Mini Orca Small, no GPU. only auto and Cpu

[cosmic-snow]

Another possibility is that it doesn't support all the Vulkan features that are required. But myself, I don't have the insight to tell you whether it does. I'll leave this to the more knowledgeable people.

[BoBBer446]

same here:

[cebtenzzre]

NVIDIA's Pascal GPU architecture is currently not supported, due to lack of Vulkan 1.2 shader float16 support. I am working on a change that shows this kind of information in the GUI:

[BoBBer446]

Sounds good :) Or you send me a supported card 😃😅.

But all kidding aside: Thanks for your really hard and great work 🙏 respect for you!

[senkron24]

yeah pls paskal support

[fukuro-kun]

It was a hard 5 h search to finally understand the problem. Maybe it would be nice to mention this lack of NVIDIA's Pascal GPU architecture support at a more prominent place.