vashat

Hi! Trying to build a chat with openai chatgpt that can make use of info from my own documents. If I use LLMChain the chat behaves exactly like in openai...

Hi! Trying to run the server with more slots that 6 by setting the parameters -np and -cb like this: ./server -m models/mixtral-8x7b-instruct-v0.1.Q5_K_M.gguf --host 0.0.0.0 --ctx_size 8192 -t 8 -ngl...