gpt4all icon indicating copy to clipboard operation
gpt4all copied to clipboard

GPT4ALL LORA exits after displaying three lines without starting the interaction

Open imranaalam opened this issue 1 year ago • 2 comments

I'm trying to run GPT4ALL LORA using the following command:

./gpt4all-lora-quantized-win64.exe -m gpt4all-lora-quantized-OSX-m1 -m gpt4all-lora-unfiltered-quantized.bin

However, when I execute the command, the script only displays three lines and then exits without starting the model interaction. The output I receive is as follows:

main: seed = 1680818455 llama_model_load: loading model from 'gpt4all-lora-unfiltered-quantized.bin' - please wait ... llama_model_load: ggml ctx size = 6065.35 M

Expected behavior: The script should start the model and allow me to interact with it.

Environment:

  • Operating System: windos 10
  • GPT4ALL LORA version: latest branch. ./gpt4all-lora-quantized-win64.exe -m gpt4all-lora-quantized-OSX-m1 -m gpt4all-lora-unfiltered-quantized.bin

Please let me know if there is any additional information I can provide to help diagnose and resolve this issue. Thank you!

imranaalam avatar Apr 06 '23 22:04 imranaalam

Why do you have 2 -m arguments? It's the model path

BecauseTheWorldIsRound avatar Apr 07 '23 15:04 BecauseTheWorldIsRound

Does your cpu support AVX2?

valdasn avatar Apr 09 '23 10:04 valdasn

Stale, please open a new issue if this is still relevant.

niansa avatar Aug 11 '23 11:08 niansa