iChristGit

Also, I am using Text-Generation-Webui, do you use the same? Edit: I was using the original meta fp16 model, now when generating with the GGUF version it works fine!

> In prod for HuggingChat this is what we use: > > ``` > "tokenizer" : "philschmid/meta-llama-3-tokenizer", > "parameters": { > "stop": [""] > } > ``` > > chat-ui...

> You can keep preprompt but you should get rid of the chatPromptTemplate yes! Il try that! although the current config works flawlessly! Thank you

For me its working since release, here is the local.env: ``` MONGODB_URL=mongodb://localhost:27017 USE_LOCAL_WEBSEARCH=true PUBLIC_APP_ASSETS=chatui HF_ACCESS_TOKEN=hf_none PUBLIC_APP_DESCRIPTION="ChatGPT But Open Source!" PUBLIC_APP_NAME=ChatGPT MODELS=`[ { "name": "Llama-3", "description": "Meta Llama3 is a great...

 Just fresh installed using v6.7 bat file installer, same results

Managed to fix the issue by using the latest bat file made 20 hours ago (not in release page) Yi-34B and Deepseek coder models are not working, GPTQ seems fine

Are there any ETA for this issue? or workaround fix? I disabled the feature for the music library for now 

Still an issue on Windows with 10.10.6 Bugs the heal out of me that the task is marked as Failed.. I just want to get rid of it.

Upping this as its an issue for some of me as well.