Matvey Soloviev
Matvey Soloviev
Ouch, sorry. I thought shutdown would trigger the same signals as closing the window manually, but apparently not...? Maybe the best solution to this indeed is a periodic autosave.
I think this may be a consequence of Gtk3's "gesture management" hijacking touch events. I'm looking at whether there's a way to switch it off completely; if not, I might...
Right now, parts of the internal settings are not recomputed if the theme is changed while Notekit is running. Blockquote text should get an appropriately bright colour if you start...
> I cant seem to find any keystrokes to change between tools, as I'm using a drawing tablet i would love to be able to change settings with keyboard input....
The [actual quantization algorithm](https://github.com/qwopqwop200/GPTQ-for-LLaMa/blob/main/gptq.py) (spread across that file and [another](https://github.com/qwopqwop200/GPTQ-for-LLaMa/blob/main/quant.py)) seems to be a little hairy, and uses some nontrivial linear algebra (Cholesky decomposition) that we'd either have to reimplement...
I just committed in some code to get AVX2-accelerated Q4_1 inference into a [new branch](https://github.com/ggerganov/llama.cpp/tree/q4_1_accel). Since I've never written any sort of SIMD code before, this was a bit of...
Thanks! I implemented almost all of these more or less as you said. (I still accumulate the scalars, though I wondered if lifting up the multiplication to be near the...
The `[end of text]` output corresponds to a special token (number 2) in the LLaMa embedding. As for stopping on other token strings, the "reverse prompt" parameter does that in...
Fixed in latest version.
How's that C++ library coming along? A three-way merge in general requires access to the latest common ancestor of the two documents, which in a syncing setting would require knowing...