m-from-space

Here is an example of the issue:  ``` default persistent.VARIABLE = True default persistent.SOME_VARIABLE = True default persistent.SOME_OTHER_VARIABLE = True label start: $ v = persistent.VARIABLE $ v =...

Strange color coding on calling screen and with statement

1

For some reason the "with" statement and its arguments gets color coded red when used as part of a "call screen" statement. It's confusing and not consistent with other "with"...

Set a random initial seed if using `-1` as the seed argument, like stated in the API reference here: > seed ([int](https://docs.python.org/3/library/functions.html#int), default: [LLAMA_DEFAULT_SEED](https://llama-cpp-python.readthedocs.io/en/latest/api-reference/#llama_cpp.llama_cpp.LLAMA_DEFAULT_SEED) ) – > > RNG seed,...

Setting seed to -1 (random) or using default LLAMA_DEFAULT_SEED generates a deterministic reply chain

3

INB4 This is **not about setting Top-P to 1.0** which causes the same output every time for every same prompt, documented here: https://github.com/abetlen/llama-cpp-python/issues/1797 When loading a model with release 0.3.1...