Are there any other GPT4All-J compatible models of which MODEL_N_CTX is greater than 2048?

[fishfree]

I tried ggml-mpt-7b-instruct.bin of which MODEL_N_CTX is 4096. But error occured when loading:

gptj_model_load: loading model from 'models/ggml-mpt-7b-instruct.bin' - please wait ...
gptj_model_load: invalid model file 'models/ggml-mpt-7b-instruct.bin' (bad magic)
GPT-J ERROR: failed to load model from models/ggml-mpt-7b-instruct.bin

[darrinh]

Have been getting similar errors with various models as per below, the error is the same:

gptj_model_load: invalid model file 'models/mpt-7b-instruct.ggmlv3.q8_0.bin' (bad vocab size 2007 != 4096)

[ProxyAyush]

yeah so in privateGPT on line 36 change " backend='gptj' " to " backend='mpt' "