Instance in Windows no Run Chat4all in GPU

[nelsonxx1]

System Info

I have a pc with the following specifications: CPU: i9 12900K RAM: 64GB DDR5 GPU: NVIDIA 4090

When I run the windows version, I downloaded the model, but the AI ​​makes intensive use of the CPU and not the GPU

here video https://mega.nz/file/P4w2jRLC#ExtYRQ_W2sCYcusFZT639mf5J5yZYrSYQm6xhamAGEY

Information

• [ ] The official example notebooks/scripts
• [ ] My own modified scripts

Related Components

• [ ] backend
• [ ] bindings
• [ ] python-bindings
• [x] chat-ui
• [ ] models
• [ ] circleci
• [ ] docker
• [ ] api

Reproduction

1. open applicatgion web in windows
2. dowload model gpt4all-l13b-snoozy
3. change parameter cpu thread to 16
4. close and open again.
5. write request

Expected behavior

When I run the windows version, I downloaded the model, but the AI ​​makes intensive use of the CPU and not the GPU

[cosmic-snow]

Well yes, it's a point of GPT4All to run on the CPU, so anyone can use it. It's the first thing you see on the homepage, too:

A free-to-use, locally running, privacy-aware chatbot. No GPU or internet required.

There already are some other issues on the topic, e.g. #463, #487, and it looks like some work is being done to optionally support it: #746

[JohnClaw]

Well yes, it's a point of GPT4All to run on the CPU, so anyone can use it.

That's not true in my case. Gpt4all doesn't use my cpu at all but loads igpu up to 100%. How can i fix that?

[cosmic-snow]

That's not true in my case. Gpt4all doesn't use my cpu at all but loads igpu up to 100%. How can i fix that?

Unless you've done a custom build and enabled the GPU somehow, I seriously doubt that. But yes, it'll load it up to 100%, because it takes a lot of resources to run, even for what seems like simple things. It's not simple.

[JohnClaw]

Unless you've done a custom build and enabled the GPU somehow, I seriously doubt that.

I didn't make any custom builds. I am an ordinary PC user without any knowledge in such complicated things. How can i turn off the igpu's usage and turn on cpu's usage?

[cosmic-snow]

I didn't make any custom builds. I am an ordinary PC user without any knowledge in such complicated things. How can i turn off the igpu's usage and turn on cpu's usage?

If you're just using the downloader for the chat application, then it only runs on the CPU. I don't understand what you're seeing.

[labrat97]

You are seeing oneAPI run.