gpt4all icon indicating copy to clipboard operation
gpt4all copied to clipboard

Run gpt4all on GPU

Open Vcarreon439 opened this issue 1 year ago • 2 comments

How can I run it on my GPU? I didn't found any resource with short instructions. I install it on my Windows Computer

Vcarreon439 avatar Apr 03 '23 03:04 Vcarreon439

+1. An easier to follow guide for GPU would help a lot of people out

2vsh avatar Apr 05 '23 04:04 2vsh

Clarification: Cause is lack of clarity or useful instructions, meaning a prior understanding of rolling nomic is needed for the guide to be useful at its current state.

Speaking w/ other engineers, this does not align with common expectation of setup, which would include both gpu and setup to gpt4all-ui out of the box as a clear instruction path start to finish of most common use-case

edit: I think you guys need a build engineer

osakanone avatar Apr 13 '23 16:04 osakanone

There is Metal support now

niansa avatar Aug 10 '23 15:08 niansa

CUDA Support on bare metal when? =D

supere989 avatar Aug 15 '23 11:08 supere989

CUDA Support on bare metal when? =D

There is an experimental pull request for that, but you'd have to build it yourself: #746

cosmic-snow avatar Aug 15 '23 13:08 cosmic-snow