DrMeer

Looping and Offline start.

6

This is two issues. 1. Dalai will start to loop the last text infinitely instead of stopping. 2. "npx dalai serve" only seems to work if the computer is online....

Editting Entries During Generation Breaks Generation

1

If you try to change the contents of actions/entries (at least the last one) during text generation, text generation will cease and the formatting process that stiches the tokens together...

As the title suggests. Sometimes they aren't saving, deleting themselves as soon as they are made. (This is the 4-bit experimental UI version.)

As the title suggests. Anytime world info keywords are triggered any text associated with the generation ends up disappearing more than half the time. Trying to go back and recall...

Is there a way to change the seed without restarting KoboldAI so that it is guaranteed a different output each generation?

Tried running it with q5_1 ggml files but it is interpreting them as q6_k

5

KeyNotFoundException: The given key 'Q6_K' was not present in the dictionary. System.Collections.Generic.Dictionary`2[TKey,TValue].get_Item (TKey key) (at :0) GGMLTraitTypeExtensions.GetTraits (GGMLType type) (at D:/01_Unity/2023-09-29_PerroPastor-master/UnityPackage/Loaders/GGMLTypes.cs:189) GGMLLoader.CalculateTensorSize (TensorMeta tensor) (at D:/01_Unity/2023-09-29_PerroPastor-master/UnityPackage/Loaders/GGMLLoader.cs:341) GGMLLoader.ReadTensorMetadata (System.IO.BinaryReader reader, GGMLFileVersion...

Doesn't work with 4bit?

3

Tried using with several ggml bins (some from TheBloke, some from GPT4All) and it seems like this code only works with models not labeled as 4bit? Or am I missing...