chrisbarrera

Model file is: qwen1_5-1_8b-chat-q4_0.gguf downloaded directly from the Qwen page on huggingface. % cksum qwen1_5-1_8b-chat-q4_0.gguf 1501852466 1120235360 qwen1_5-1_8b-chat-q4_0.gguf Default prompt templates. For me, just typing that query will have it...

Links: https://huggingface.co/Qwen/Qwen1.5-1.8B-Chat-GGUF/tree/main https://huggingface.co/Qwen/Qwen1.5-1.8B-Chat-GGUF/resolve/main/qwen1_5-1_8b-chat-q4_0.gguf?download=true

This seems to no longer be a problem in v3.0.

I can replicate this problem (as I was testing for someone else's different localdocs crashing problem). Crashed Thread: 6 embedding Exception Type: EXC_CRASH (SIGABRT) Exception Codes: 0x0000000000000000, 0x0000000000000000 Termination Reason:...

(wazoox) sorry I was directing my comment to the devs. However, I am sure anyway you can help would be appreciated. (for the devs) continued to look at this, appears...

The problem went away when I removed localdocs* db under 2.8.0 and recreated the localdocs dbs, but I could replicate it by removing it again and rerunning under 2.7.5 to...

You are most likely running out of VRAM, which uses a portion of that 32GB of RAM. The tell is failing in load tensors -i.e. loading a model that is...

Screen capture showing interaction: muted text of the filename following the "You" in the conversation area, and a paperclip icon on the right side of the textinput field.

Hey @manyoso thanks for the feedback. I am just glad either way that its on the board and y'all will add this as a feature. Feel free to use as...

I'm not from Nomic, but I have to ask what is the benefit of even 64 CPU threads? Have you benchmarked 64 threads vs 32, 16, or even 8, and...