Johannes Gäßler

To clarify: you can manually move the database file but then the paths are wrong because they are relative to the database.

tmsu repair did not work as expected when I created a directory with some simple files and then tried to repair the paths after moving the database; some files were...

I am using tmsu to tag directories. I made a backup of my database file and then tried fixing the paths with tmsu repair after moving the database file. None...

Does getting the seeds from the info files not work for you?

>The issue is that converting weights from bf16 to fp16 will cause 3 bits of knowledge to be lost. There is currently no way to evaluate models like Mistral at...

>By my calculation, only 0.29101% of Mistral 7b's numbers are broken. Broken in what sense? Numbers being flushed to zero is not an issue because the difference between 0 and...

>Am I correct in understanding you won't merge this? That surprises me. This project recently accepted nine novel "IQ" quantization formats, which I know very little about. So I was...

Relevant for discussion: https://github.com/Mozilla-Ocho/llamafile/commit/ef0307ea62c8631a9b67acee02afeef8979d89eb It seems there seem to be at least some values above the maximum value representable by IEEE 754 half precision floats. @jart do you know in...

I cannot reproduce the issue using 3x P40. Are you running llama.cpp inside a virtual machine or WSL?

I have no intention to support CUDA 10. As slaren said, if you want it supported you are free to put in the effort yourself and I will then happily...