voarsh2

Retested 0.2.55 tag and it's working for the most part. Any thoughts on Jira DC? 🤔 Any interest?

> https://docs.danswer.dev/gen_ai_configs/gpt_4_all > Where are you seeing the INTERNAL_MODEL_VERSION. I think you may be referring to outdated docs. Please share where it is so I can correct it. It complains...

> Be sure you're on the latest version of the code as well. If you're still seeing INTERNAL_MODEL_VERSION, then you must be on a pretty old version Yes, the branch...

> It is no longer used, that's why I was wondering if you were on an old version. Is the new docs/environment settings for setting up GPT4All not working for...

Perfect. Waiting for my build to build all the Dockerfiles and will test again against 0.2.65 tag using just: ``` GEN_AI_MODEL_PROVIDER=gpt4all GEN_AI_MODEL_VERSION=mistral-7b-openorca.Q4_0.gguf ``` Will also update my PR to remove...

I gave it another try. I used the options you suggested: ``` GEN_AI_MODEL_PROVIDER=gpt4all GEN_AI_MODEL_VERSION=mistral-7b-openorca.Q4_0.gguf ``` ``` During handling of the above exception, another exception occurred: Traceback (most recent call last):...

Any time to tell me how to get the local LLM in memory working?

That issue has gone away, it seems, but I can't test it because ```mistral-7b-openorca.Q4_0.gguf``` doesn't seem to work on AVX1 CPU's? ``` double free or corruption (!prev) 2023-11-29T23:32:50.100321020Z Aborted (core...

I second this. For a self-hosted software, it should definitely have some on-premise application support. Only one I saw is Bookstack - but enterprises will also be making use of...

I find it strange the default was set to 100 - and you recommend 2/3? How many epochs did you run when you make your checkpoints public - that would...