llama-gpt
llama-gpt copied to clipboard
getumbrel
A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!
This pull request introduces support for Llama 3 8B model with GGUF format. The high-level changes are: 1. Updated llama-cpp-python to v0.2.63. The previous version was causing the API to...
Well, the title says it all. It might be tricky to get a AI to say nothing, but it happens.
Hi i am trying to increase the token size of llama and codellama, and i am unable to do so.
With both Intel and AMD releasing CPUs with NPUs (Neural Processing Unit) in their laptop CPU designs, NPUs being a part of the Orange Pi design, and the Raspberry Pi...
Hello everyone! Just wanted to create an issue so there is something to subscribe to. Hopefully there will be enough interest for it to be implemented. Thank you for the...
Hi, I wanted to try the model code-7b, but I got this error : ``` llama-gpt-llama-gpt-ui-1 | [INFO wait] Host [llama-gpt-api:8000] not yet available... llama-gpt-llama-gpt-api-1 | /usr/local/lib/python3.11/site-packages/setuptools/command/develop.py:40: EasyInstallDeprecationWarning: easy_install command...
There was some internal server error when running `run-mac.sh` on Mac. To fix this, I updated llama_cpp_python version to the latest version. This will resolve #73 and #95 .
