dsignarius

Results 3 comments of dsignarius

I would echo the suggestion to try Koboldcpp The api functions well and provides all sides, together with web gui for both text and image. The z-image is being worked...

amdgpu radv / vulkan / deb (old drivers not current) The Jayn7 Q4_K_M works here, used for tests earlier. Taking bf16 safetensors and using sd convert to q8_0 works. Taking...

I was running an earlier version of koboldcpp used on same CPU/iGPU and was working fine without disabling F16. Updated it yesterday to try out gemma3. It ran fine on...