kalomaze
kalomaze
### Issue Type Feature Request ### vc client version number N/A ### OS N/A ### GPU N/A ### Clear setting yes ### Sample model yes ### Input chunk num yes...
On my Windows machine, TinyLlama inferences properly, but the model is not properly stored as .gguf format due to the period in the model title.
To be merged for when https://github.com/ggerganov/llama.cpp/pull/6445 is merged
### Please check that this issue hasn't been reported before. - [X] I searched previous [Bug Reports](https://github.com/OpenAccess-AI-Collective/axolotl/labels/bug) didn't find any similar reports. ### Expected Behavior With 8-bit LoRA enabled and...
Being able to see probability on the kobold API backend would be a nice addition
- Generated text will be green, user text will be grey. - Terminal style font (monaco). - Rest of the theme is using a grayscale palette. ![image](https://github.com/lmg-anon/mikupad/assets/66376113/633d727c-e232-47cc-b0d5-0d3ca834e491) Currently there is...