gpt4all
gpt4all copied to clipboard
[Feature] GPU support for GPT-J
Bug Report
When using Mac set to use metal, gpt-j model fails to fallback to CPU.
Steps to Reproduce
- With a Mac set application device to use metal.
- Try to load a gpt-j architecture model.
- With a Mac set application device to use CPU.
- Load the same gpt-j architecture model.
Expected Behavior
The gpt-j model has no GPU support should fallback to CPU.
Your Environment
- GPT4All version: 2.8.0
- Operating System: Mac
- Chat model used (if applicable):
https://huggingface.co/EleutherAI/gpt-j-6b
converted to gguf.
Works in windows as expected with Vulkan.