gpt4all icon indicating copy to clipboard operation
gpt4all copied to clipboard

Published 20 hours ago • verified publisher icon nomic-ai

Chat UI crashes for long inputs

Open shamio opened this issue 1 year ago • 1 comments

I am running the latest version of GPT4all, version 2.7.0, on Windows 11 Pro. Whenever I provide a long input to a model, the program crashes immediately after it finishes responding, and I am unable to use it again. Can you please identify the reason for this error and provide a solution to fix it? Your assistance would be greatly appreciated.

shamio avatar Feb 24 '24 14:02 shamio

I can reproduce a crash with inputs greater than n_ctx tokens - it segfaults in llama_sample_top_p_top_k.

cebtenzzre avatar Mar 12 '24 20:03 cebtenzzre