LLMUnity

LLMUnity copied to clipboard

Need to add CFG Scale and CFG and context free grammars

8

ArEnSc

Add Android support

8

Purpose of this features is to add support of LLMUnity for Android Issues: - llamafile does not support Android, the llama.cpp server binary will need to be separately compiled -...

amakropoulos

Saving the Chat Log

1

### Describe the feature Saving the chat log for the AI to remember in the future what conversation it had with the user.

DinisB

Persist user interaction to disk so that it can be continued

1

llama.cpp allows to store the conversation along with the processed tokens to disk so that the interaction can be resumed at the next run. Purpose of this feature is to...

amakropoulos

llamafile issue on mac M2

2

### Describe the bug Hi! can't run on Mac. When run Unity chat scene looks like can't connect to server. ### Steps to reproduce _No response_ ### LLMUnity version _No...

Alexnnn

VisionOS iOS support

1

### Describe the feature Hi! Is this supported on iOS/VisionOS?

yosun

amakropoulos

Function calling

1

### Describe the feature Hi, I wonder if it is possible to add custom tools to the LLM to make it do something like, create a new cube in the...

xumeng12321

Image Input

3

### Describe the feature hello. llamafile seems to have image input functions such as jpg/png/gif/bmp. Example) llamafile -ngl 9999 --temp 0 \ --image ~/Pictures/lemurs.jpg \ -m llava-v1.5-7b-Q4_K.gguf \ --mmproj llava-v1.5-7b-mmproj-Q4_0.gguf...

Legerdo

Add optional callback for problem handling

1

### Describe the feature Currently, if the server does not start, you only produce a Debug.LogError(). That's fine for developing purposes, but if this happens on a customer machine, the...

upost