godot-llm icon indicating copy to clipboard operation
godot-llm copied to clipboard

Use llama3.1

Open AlexDe-v opened this issue 1 year ago • 5 comments

Does anyone know how to use llama3.1 or 3 in this addon. I've tried downloading "Meta-Llama-3.1-8B-Instruct-Q2_K.gguf" from https://huggingface.co/bullerwins/Meta-Llama-3.1-8B-Instruct-GGUF/tree/main but it doesn't seem to work.

AlexDe-v avatar Aug 08 '24 11:08 AlexDe-v