LLMuser

Results 1 comments of LLMuser

Gibberish output on Quadro (Maxwell *and* Turing?)

**Bug Report** Response is gibberish when using longer prompts with GPU (NVIDIA Quadro K6000). Happens with any model. No problems when using CPU. **Steps to Reproduce** - Select "Vulkan: Quadro...