GPT4All crashing after inputting long text.

[chenwei025025]

Have any of you encountered the problem of GPT4All crashing? Whenever I input a slightly longer text and hit enter, the software just crashes.

[pkootstra]

this is caused by a buffer overflow in the interactive mode of alpaca.cpp, of which GPT4All is a fork. The input buffer is only 256 bytes long, so inputting more than 254 characters of text (plus the carriage return and line feed) will overflow this buffer and cause the program to crash, see: https://github.com/antimatter15/alpaca.cpp/issues/119

[chenwei025025]

thank you very much.

[Villagerjj]

how do we increase this buffer?

[PlutoniaX]

Anyway to increase the buffer?

[pkootstra]

Anyway to increase the buffer?

Not without recompiling the program. But you can work around it by splitting up long lines using a backslash, like this:

Pretend this is a very long line, \
that has been split up into two lines.\
This is the final line...

[pomeara]

Let's do a recompile to at least catch the long string and exit with a graceful message vs crashing

[niansa]

Stale, please open a new issue if this is still relevant.