Marcel Welland
Marcel Welland
Function Calling, as i understand it, would be similar to command detection maybe through sentence similarity or intend recognition, like for ex. the input "Hello" -> callfunc WaveHand()
Caused by calling Load() multiple times during warmup for different chats on the same bot.
Here the Editor Log: {"tid":"0x3fc9c7000","timestamp":1723583356,"level":"INFO","function":"print_timings","line":321,"msg":"prompt eval time = 26406.68 ms / 2699 tokens ( 9.78 ms per token, 102.21 tokens per second)","id_slot":0,"id_task":41,"t_prompt_processing":26406.678,"n_prompt_tokens_processed":2699,"t_token":9.783874768432753,"n_tokens_second":102.2089942551653} {"tid":"0x3fc9c7000","timestamp":1723583356,"level":"INFO","function":"print_timings","line":337,"msg":"generation eval time = 12923.37 ms / 76...
Hi, i have checked the latest release and noticed that the llmCharacter WarmupCallback _can_ return before llm.started. Combined with a Nullref in the callback allegedly caused the original error above....
This i not exactly my expertise and I'am just guessing that it could be a UnityMainThread vs. Tasks thing. Here is what i found: Tasks may not synchronize correctly with...