3Simplex
3Simplex
Still working out some issues here. (Updates below addressed them.)
Yes, it looks good!
My buffer is only getting 2gb on windows with my rx6900xt. It should be capable of 4gb.
> > My buffer is only getting 2gb on windows with my rx6900xt. It should be capable of 4gb. > > You could try setting the env var GGML_VK_FORCE_MAX_ALLOCATION_SIZE to...
Looks like I have increased the buffer, the previous max was about 30-40k new prompt, n_ctx_slot = 82944, n_keep = 0, n_prompt_tokens = 25508 I'm not sure if the system...
It turns out that this setting in the "Vulkan Configurator" caused the problem.  ``` VUID-VkBufferCreateInfo-size-06409(ERROR / SPEC): msgNum: -332260500 - Validation Error: [ VUID-VkBufferCreateInfo-size-06409 ] | MessageID = 0xec321b6c...
> I am getting the same issue but I can't find that setting on the vulcan configurator... Yours is something like this ? > I have v.2.6.2 it appears to...
Thank you for your effort on this, we are all waiting patiently for the rope to be finished! We have some great functionality in GPT4All with this new model! 