Botoni

I also can't use the gpu, with both tensorflow2.0.0 and tensorflow-gpu2.0.0 installed, it uses the cpu, with only tensorflow-gpu installed it gives me the error `ModuleNotFoundError: No module named 'tensorflow'`...

Same thing happens to me with an nvidia card (3070). Fedora 39 kernel 6.6.4 self compiled. Only reference to GPU are in options, but no trace of it in the...

Thank you @aristocratos I've found the problem looking myself at the log, libnvidia-ml.so was named libnvidia-ml.so.1 in my system, so it wasn't found. I created another symlink named libnvidia-ml.so and...

If it helps the implementation, using the lmstudio config, the koboldcpp terminal gives this response when sending a prompt: `Processing Prompt [BLAS] (509 / 509 tokens) Generating (10 / 100...

If it helps with anything, the host.docker.internal addres works for me in my linux machine, in my case Fedora 39 and Lm studio.

The same happens to me, and also can be seen in the samples in the github page. There's a color/saturation shift from the reference frame to the following ones. Here's...