phalexo
phalexo
Also the larger DeepSeek coder.
I also have noticed that sources files often (not always) have -----------------------------format------------------------------------- at the beginning, and ---------------------------end of format-------------------------------- at the end. obviously this causes node to throw an error.
The problem appears to be comments that an LLM may make BEFORE and AFTER formatted JSON. For example: Here is JSON formatted ...... Can I help you with something else?...
Even after changed prompting that reduced the problem with JSON formatting, actual useful function using phindcodellama and deepseek33b is pretty much non-existent. It seems that gpt-pilot is optimized for GPT-4...
Infinite loop here too. FROM /opt/data/MaziyarPanahi/Meta-Llama-3-70B-Instruct-GGUF/Meta-Llama-3-70B-Instruct.Q5_K_S.gguf TEMPLATE """{{ if .System }}system {{ .System }}{{ end }}{{ if .Prompt }}user {{ .Prompt }}{{ end }}assistant {{ .Response }}""" PARAMETER num_ctx 8192...
Ok, this quantized version works after ollama import. FROM /opt/data/QuantFactory/Meta-Llama-3-70B-Instruct-GGUF/Meta-Llama-3-70B-Instruct.Q5_K_M.gguf TEMPLATE """{{ if .System }}system {{ .System }}{{ end }}{{ if .Prompt }}user {{ .Prompt }}{{ end }}assistant {{ .Response...
I have llama3-70b-instruct Q5 working with gptpilot. Appears quite stable. On Mon, Apr 29, 2024, 6:58 AM Oli Norwell ***@***.***> wrote: > For me Llama3 works as expected in Ollama...
I am running gpt-pilot with Llama-3-70B-Instruct.Q5_K_M It does not seem to suffer from malformed JSON issues, although it has other problems. I changed the source to have 3000 timeout for...
> Thanks for sharing that. I guess I'd need a memory upgrade then. on 32gb. will 64gb do? I already changed api timeout to 30 min because I still got...
> Yikes.. getting an error > > ``` > Cannot access gated repo for url https://huggingface.co/meta-llama/Meta-Llama-3-8B/resolve/main/config.json. > Access to model meta-llama/Meta-Llama-3-8B is restricted. You must be authenticated to access it....