godot-llm
godot-llm copied to clipboard
Adriankhl
LLM in Godot
I point the file to the .gguf but only receive this output when attempting to generate text
``` ❯ godot -e Godot Engine v4.2.2.stable.arch_linux - https://godotengine.org OpenGL API 3.3.0 NVIDIA 550.78 - Compatibility - Using Device: NVIDIA - NVIDIA GeForce RTX 3090 WARNING: Blend file import is...
First of all, thank you for this addon, it opens up so many possibilities. I do not have extensive experience with LLMs, although I have been using ChatGPT for a...
I tried to run it on igpu AMD Radeon Graphics Vega 7 but no text was generated.
I once advised you to add GPT4ALL, since there is a function with which you could set the nature of the answers, what the model likes, who she is, etc....
We also made something based on ggml. https://github.com/V-Sekai/v-sekai.whisper We were able to add opencl acceleration and build for multiple platforms. Thanks to @Ughuuu Do you want us to send help?
Does anyone know how to use llama3.1 or 3 in this addon. I've tried downloading "Meta-Llama-3.1-8B-Instruct-Q2_K.gguf" from https://huggingface.co/bullerwins/Meta-Llama-3.1-8B-Instruct-GGUF/tree/main but it doesn't seem to work.
The `GDLlama` node's `run_generate_text` method causes stuttering despite running in the background, sometimes freezing the whole operating system. (Windows 11 Desktop)
Hello I was thinking of building a project similar to this myself but came across yours. Are you accepting contributions assuming I find the time ? I ask because I...
Even though I'm using a gpu build, inference is running on cpu/ram. I tried to tinker with parameters, but with no luck. Log: ``` Godot Engine v4.3.stable.mono.official.77dcf97d8 - https://godotengine.org TextServer:...
