LLMUnity
LLMUnity copied to clipboard
Create characters in Unity with LLMs!
### Describe the feature Integration with the Playmaker Unity plugin: https://assetstore.unity.com/packages/tools/visual-scripting/playmaker-368
### Describe the feature With the introduction of the fallback to `CPU `and `--no-mmap` I was thinking. Maybe start up can be sped up on a repeated run by remembering...
### Describe the bug When not in directly in StreamingAssets, models wont be found. For ex. a path like StreamingAssets/MyLLMs/model.gguf will fail to load the model. ### Steps to reproduce...
### Describe the bug Hello, for this and the previous version i get regular crashes (aprox. 1 start of 3) on osx. Build and Editor, acc and noAcc. ================================================================= Managed...
### Describe the bug Crash with abort when trying to use AMD graphics card in editor Model is mistral-7b-instruct-v0.2.Q4_K_M.gguf ggml_cuda_init: found 1 ROCm devices: Device 0: AMD Radeon RX 6800...
### Describe the bug This happens if asynchronous startup is true. When you exit playmode after the "Server command" log but before the "LLM service created" log, then the editor...
Added a new component LLMChatHistory, which takes on the responsiblity of managing a list of chat messages. The LLMCharacter now simply calls it's attached LLMChatHistory component. First part of a...